Model Finder

Plugin model-finder from marketplace model-finder in Abhiindigloo/EvalHarness. Commands read from the repo's manifest — 9 days ago.

Skills (4)

• eval-models

  Run the user's own examples against several AI models (Claude, Gemini, OpenAI, or any OpenAI-compatible endpoint including local Ollama or vLLM) and measure pass rate, latency, and billed cost to find the cheapest model that meets their quality bar. Use whenever the user wants to test, benchmark, ev

• find-model

  Compare and recommend AI models across providers (Anthropic Claude, Google Gemini, OpenAI, Bedrock, Vertex AI, Azure, Mistral, open-weight and local models) for a specific task, budget, and deployment route. Use whenever the user asks which model to use, whether a cheaper model is good enough, how m

• route-models

  Generate a cheapest-first model routing setup with fallbacks and quality escalation, from eval-models results or a user-chosen model order. Produces a standalone Python router (escalates when a reply errors or fails format guards), a routing.json, and a LiteLLM proxy config (error-based fallbacks).

• size-local-model

  Estimate the GPU or unified memory needed to run an open-weight model locally, covering weights at a given precision or quantization plus KV cache for a chosen context length and concurrency, and compare it with available memory. Use whenever the user asks whether a model fits their GPU, Mac, or ser

MCP servers (1)

• model-finder

  runs: python3 ${CLAUDE_PLUGIN_ROOT}/mcp/server.py

Similar plugins