claude

evaluate-plugin

Skill evaluation and benchmarking - test skill effectiveness with behavioral eval cases, grade results, and track quality improvements

60 on GitHubby Lauri Gatesv1.20.2MITupdated todayquality
/

Plugin evaluate-plugin from marketplace laurigates-claude-plugins in laurigates/claude-plugins. Commands read from the repo's manifest — today.

This plugin runs code on your machine — its hooks fire automatically on events like tool use. The exact commands are listed below; read them before installing.

What it installs

Skills (7)

  • evaluate-context-engineering

    Context-engineering audit (C1-C6) of skills and always-loaded rules. Use when trimming context bloat, auditing a plugin, or after a new Claude model ships.

  • evaluate-improve

    Suggest improvements to SKILL.md content, descriptions, or tool config from eval results. Use when raising pass rates, fixing triggering, or iterating on a skill after evaluation.

  • evaluate-legibility

    Cold-read a SKILL.md with a zero-context agent reader to check its intent is legible. Use when validating whether a skill says clearly when to invoke it and how to start.

  • evaluate-matrix

    Cross-model skill evals with real execution and grading — the executability gate. Use when checking whether a weak model can actually do a skill, not just comprehend it.

  • evaluate-plugin-batch

    Batch evaluate every skill in a plugin and produce a plugin-level report. Use when auditing an entire plugin's quality or validating before a release.

  • evaluate-report

    View evaluation results and benchmark reports for a skill or plugin. Use when reviewing past eval results, comparing benchmark runs, or tracking quality trends.

  • evaluate-skill

    Evaluate a skill by running test cases and grading results. Use when testing whether a skill produces correct guidance, validating improvements, or benchmarking before release.

Subagents (3)

  • eval-analyzer

    Analyze evaluation results to identify patterns, weaknesses, and improvement opportunities. Operates in comparison mode (with-skill vs baseline) or benchmark mode (trends across runs). Use after grading to generate suggestions.

  • eval-comparator

    Blind comparison of two outputs without knowing their origin. Rates content quality and structure quality to objectively determine which output is better. Use to compare with-skill vs baseline runs without bias.

  • eval-grader

    Grade evaluation runs against predefined assertions. Examines execution transcripts and outputs to determine pass/fail with cited evidence. Use as a subagent from evaluation orchestration skills.

Hooks (2)

  • SessionStart

    bash "${CLAUDE_PLUGIN_ROOT}/hooks/evaluate-drift-probe.sh"

  • SessionStart

    bash "${CLAUDE_PLUGIN_ROOT}/hooks/sync-evaluate-skill-workflow.sh"

View source on GitHub

More from laurigates/claude-plugins

All 50 plugins →

Project infrastructure standards - pre-commit, CI/CD, Docker, testing configuration

49 skills · hooks

60

Git workflows - commits, branches, PRs, issue processing, conflict resolution, and repository management

49 skills · 1 agent

60

Blueprint Development methodology - PRD/PRP workflow with version tracking, modular rules, CLAUDE.md management, and monorepo portfolio tracking

35 skills

60

Agent configuration utilities - project assimilation, config auditing, teammate definitions, MCP management, MCP code execution patterns

24 skills

60

Test execution, TDD workflow, and testing strategies

20 skills · 1 agent

60

Obsidian CLI operations - vault files, search, properties, tasks, plugins/themes, publish/sync, bases, command palette, file history, dev tools, workspaces, multi-vault, templates, and bookmarks

20 skills

60

Similar plugins

Collection of example skills demonstrating various capabilities including skill creation, MCP building, visual design, algorithmic art, internal communications, web testing, artifact building, Slack GIFs, and theme styling

19 skills

anthropics/skills 193,780

career-ops

claudecodex

Open-source AI job search that runs locally in your AI coding CLI: scan job portals, evaluate listings into a structured A-H report with a 1-5 score, tailor your CV, track applications

5 skills · hooks

career-ops-hq/career-ops 82,253

5 skills + 35 modes + Material Passport pipeline. Includes v3.6.7 cross-model audit gate and v3.6.8 generator-evaluator contract.

5 skills · 16 commands · 4 agents · hooks

Imbad0202/academic-research-skills 56,698

Automates browser interactions for web testing, form filling, screenshots, and data extraction

12 skills

vercel-labs/agent-browser 50,373

Backend API design, GraphQL architecture, workflow orchestration with Temporal, and test-driven backend development

9 skills · 1 command · 8 agents

wshobson/agents 42,461

promptfoo

claudecodex

Connect providers and targets, write eval suites, and set up or run red team scans with promptfoo

4 skills

promptfoo/promptfoo 27,115

Maintain evaluate-plugin?

This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.

claude & codex plugins50 plugins