claude

evals

Create fine-tuned LLM-as-a-judge evaluators on the Plurai platform

32 on GitHubby Pluraiv0.4.0updated yesterday
/

Plugin evals from marketplace plurai-plugins in plurai-ai/plurai-plugins. Commands read from the repo's manifest — yesterday.

This plugin runs code on your machine — it starts local MCP servers. The exact commands are listed below; read them before installing.

What it installs

Skills (1)

  • eval

    Use when the user wants to build an LLM-as-a-judge, evaluator, classifier, or guardrail for their AI application. Triggers on: evaluating AI outputs, judging response quality, classifying text, building guardrails, detecting hallucinations, checking grounding, prompt adherence, safety checks, conten

MCP servers (1)

  • plurai

    runs: uv run --project ${CLAUDE_PLUGIN_ROOT} python -m evals_mcp

View source on GitHub plurai.ai

More from plurai-ai/plurai-plugins

All 2 plugins →

plurai-simulation

claudecodex

Set up Plurai simulation for any AI agent.

35 skills · 1 MCP server · hooks

32

Similar plugins

career-ops

claudecodex

Open-source AI job search that runs locally in your AI coding CLI: scan job portals, evaluate listings into a structured A-H report with a 1-5 score, tailor your CV, track applications

5 skills · hooks

career-ops-hq/career-ops 82,253

ruflo-ruvllm

claude

RuVLLM local inference with chat formatting, MicroLoRA fine-tuning, and SONA adaptation

3 skills · 1 command · 1 agent

ruvnet/ruflo 81,589

academic-research-skills

claude

5 skills + 35 modes + Material Passport pipeline. Includes v3.6.7 cross-model audit gate and v3.6.8 generator-evaluator contract.

5 skills · 16 commands · 4 agents · hooks

Imbad0202/academic-research-skills 56,698

AAS AI Product & Evaluation Ops

codex

Install the "AAS AI Product & Evaluation Ops" workflow plugin from Agentic Awesome Skills.

13 skills

sickn33/agentic-awesome-skills 49,620

huggingface-skills

claude

Build, train, evaluate, and use open source AI models, datasets, and spaces.

26 skills · 1 MCP server

anthropics/claude-plugins-official 47,076

ifixai

claudecodex

Independent auditing for AI agents, open source. Claude discovers your setup, confirms the cost, and audits your agent against the one question other tools skip: is it doing the job it's supposed to do, given your business rules and org structure? Test any model (Anthropic, OpenAI, Gemini, Azure, Bedrock, …) graded by self, one independent judge, or a cross-vendor panel; each provider is billed to its own account via a key in your settings, never the command line. Results render as an interactive artifact (with a static-report fallback).

1 skill · hooks

ifixai-ai/iFixAi 45,158

Maintain evals?

This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.

claude & codex plugins2 plugins