developer-toolkit
claudeDeveloper plugin: the 19 developer skills + 2 commands. MCP servers: GitHub, Sentry, Linear, Atlassian (each needs your own account).
19 skills · 2 commands · 4 MCP servers
6
claude
evals
Measure LLM quality: LLM-as-judge, eval dataset design, regression evals, golden sets, cost/quality tradeoffs. 5 skills.
/
Plugin evals from marketplace latestaiagents in latestaiagents/agent-skills. Commands read from the repo's manifest — 8 days ago.
What it installs
Skills (5)
cost-quality-tradeoffMeasure and optimize the cost/quality curve — which model, prompt, and settings give the best quality per dollar. Covers Pareto analysis, break-even thresholds, and when to spend more vs less. Use this skill when optimizing LLM spend, picking a default model for a feature, or deciding whether a prem
eval-dataset-designDesign eval datasets that actually measure model quality — coverage, difficulty distribution, labeling consistency, and avoiding contamination. Covers sourcing, stratification, label quality, and when to generate vs curate. Use this skill when building a new eval set, realizing your current evals do
golden-set-maintenanceCurate and maintain "golden set" eval items — the small, high-signal cases that must never regress. Covers selection criteria, review cadence, retiring stale items, and keeping the set sharp. Use this skill when building a sanity-check eval that runs on every PR, defending against silent quality dro
llm-as-judgeUse an LLM as an evaluator for open-ended outputs — rubrics, pairwise comparison, calibration with human labels, bias mitigation. Covers when LLM-judge works, when it fails, and how to trust its scores. Use this skill when evaluating generative outputs at scale, building eval pipelines, or replacing
regression-evalsSet up continuous regression evals so model/prompt/tool changes don't silently break existing behavior. Covers gating thresholds, CI integration, statistical significance, and response to regressions. Use this skill when deploying prompts to production, gating model upgrades, or noticing "it worked
More from latestaiagents/agent-skills
All 29 plugins →security-guardian
claudeSecurity plugin: all 16 security skills (OWASP-category and common practices) + 2 commands. MCP server: GitHub. For the same skills without commands or MCP, install the security entry.
16 skills · 2 commands · 1 MCP server
6
devops-sre
claudeDevOps/SRE plugin: incident response, runbooks, on-call, Kubernetes troubleshooting, observability, SLOs. 8 skills + 6 commands. MCP servers: Datadog, PagerDuty, GitHub (each needs your own account).
8 skills · 6 commands · 3 MCP servers
6
agent-plugin
claudeMulti-agent plugin: the 13 agent-architect skills + 2 commands (design-agent, debug-agent). No MCP servers.
13 skills · 2 commands
6
agent-architect
claudeMulti-agent system design: supervisor and mesh patterns, handoffs, memory, tool routing, error recovery, cost budgets, testing, LangGraph, durable state, human-in-the-loop, checkpointing, A2A. 13 skills. Same skills as agent-plugin, without its commands.
13 skills
6
qa-testing
claudeQA/Testing plugin: test strategy, test writing, Playwright automation, API and performance testing. 6 skills + 3 commands. MCP servers: BrowserStack, Atlassian, GitHub (each needs your own account).
6 skills · 3 commands · 3 MCP servers
6
Similar plugins
skill-creator
claudeCreate new skills, improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, update or optimize an existing skill, run evals to test a skill, or benchmark skill performance with variance analysis.
1 skill
anthropics/claude-plugins-official 47,076
llm-finetuning
claudecodexEval-gated LLM fine-tuning lifecycle (LoRA/QLoRA, DPO, GRPO/RLVR, vision SFT, quantized export). Use when fine-tuning an open-weights model end-to-end: building the eval harness first, selecting method and model, preparing data, training with Unsloth or TRL, gating checkpoints, and exporting GGUF/FP8.
10 skills · 2 commands · 3 agents
wshobson/agents 42,461
45 advanced engineering skills: agent designer, agent workflow designer, RAG architect, database designer + schema designer + SQL assistant, migration architect, observability designer, dependency auditor, changelog generator, API design reviewer, API test suite builder, CI/CD pipeline builder, MCP server builder, skill security auditor, skill tester, performance profiler, focused-fix, browser-automation, full-page-screenshot, git-worktree-manager, monorepo-navigator, codebase-onboarding, interview-system-designer, runbook-generator, spec-driven-workflow, secrets-vault-manager, env-secrets-manager, pr-review-expert, self-eval, tc-tracker, feature-flags-architect, kubernetes-operator, chaos-engineering, ship-gate, slo-architect (error-budget + multi-window burn-rate alerts per Google SRE Workbook), tech-debt-tracker, agent-regression-evals, coding-agent-rollout, commit-craft, agent-run-forensics and i18n-localization. Agent skill and plugin for Claude Code, Codex, Gemini CLI, Cursor, OpenClaw.
48 skills · hooks
alirezarezvani/claude-skills 29,725
promptfoo
claudecodexConnect providers and targets, write eval suites, and set up or run red team scans with promptfoo
4 skills
promptfoo/promptfoo 27,115
arize-phoenix
claudecodexConnect to your Phoenix instance to debug, evaluate, and improve LLM applications.
1 MCP server
Arize-ai/phoenix 12,267
autoresearch
claudecodexAutonomous improvement engine. 14 commands with bounded defaults, chain handoff, and adaptive evals checkpoints. 95% token reduction via modular architecture.
1 skill · 14 commands · hooks
uditgoenka/autoresearch 6,833
Maintain evals?
This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.
claude & codex plugins29 plugins