claudecodexArchived

plugin-eval

Three-layer quality evaluation framework for Claude Code plugins with Elo ranking

0 on GitHubv0.1.1MITupdated 10 days ago

Not in a marketplace yet, so it loads for one session with --plugin-dir.

Plugin plugin-eval in smartwatermelon/claude-code-workflows-agents. Commands read from the repo's manifest — 10 days ago.

What it installs

Skills (1)

  • evaluation-methodology

    PluginEval quality methodology — dimensions, rubrics, statistical methods, and scoring formulas. Use this skill when understanding how plugin quality is measured, when interpreting a low score on a specific dimension, when deciding how to improve a skill's triggering accuracy or orchestration fitnes

Slash commands (3)

  • /plugin-eval:certify

    Full quality certification with badge

  • /plugin-eval:compare

    Compare two skills head-to-head

  • /plugin-eval:eval

    Evaluate a plugin or skill for quality

Subagents (2)

  • eval-judge

    LLM judge for plugin quality assessment. Scores skills on triggering accuracy, orchestration fitness, output quality, and scope calibration using anchored rubrics.

  • eval-orchestrator

    Orchestrates plugin quality evaluation. Use PROACTIVELY when evaluating, scoring, or certifying plugin quality.

View source on GitHub

Problems found in this repo's manifests

  • .claude-plugin/marketplace.json is not valid JSON
  • .agents/plugins/marketplace.json is not valid JSON

More from smartwatermelon/claude-code-workflows-agents

All 91 plugins →

python-development

claudecodex

Modern Python development with Python 3.12+, Django, FastAPI, async patterns, and production best practices

16 skills · 1 command · 3 agents

0

backend-development

claudecodex

Fork of wshobson/agents (comprehensive-review plugin source) with trimmed agent descriptions

9 skills · 1 command · 8 agents

0

agent-teams

claudecodex

Fork of wshobson/agents (comprehensive-review plugin source) with trimmed agent descriptions

6 skills · 7 commands · 4 agents

0

ui-design

claudecodex

Fork of wshobson/agents (comprehensive-review plugin source) with trimmed agent descriptions

9 skills · 4 commands · 3 agents

0

cloud-infrastructure

claudecodex

Cloud architecture design for AWS/Azure/GCP/OCI, Kubernetes cluster configuration, Terraform infrastructure-as-code, hybrid cloud networking, and multi-cloud cost optimization

8 skills · 7 agents

0

llm-finetuning

claudecodex

Eval-gated LLM fine-tuning lifecycle: LoRA/QLoRA SFT, preference optimization (DPO/ORPO/KTO), GRPO/RLVR, vision SFT, and quantized export — Unsloth-first with TRL fallback, no eval harness means no fine-tune

10 skills · 2 commands · 3 agents

0

Maintain plugin-eval?

This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.

claude & codex plugins91 plugins