claude

eval-engineer

Build, run, validate, and manage A/B evals for skills in this repo: replay real tasks, compare skill versions on cost and quality, and validate the eval before trusting it.

0 on GitHubby CharlieMITupdated 20 days agodevelopment
/

Plugin eval-engineer from marketplace mistakenot-skills in mistakenot/skills. Commands read from the repo's manifest — 20 days ago.

What it installs

Skills (2)

  • eval-engineer

    Builds, runs, validates, and manages A/B evals for repo skills — replay real tasks, compare skill versions on cost and quality. Use when 'eval this skill', 'is the new version better', 'set up/benchmark an eval', 'A/B the skills', or before trusting a non-trivial skill change. Not for ad-hoc one-off

  • plan-review

    Improves new-task-quick through a human-review loop: generate plans, blind open coding, failure-mode labels, change, regenerate, compare. Use when 'plan review', 'open coding', 'improve plan quality'. Not for one task's docs (use review-task).

View source on GitHub

More from mistakenot/skills

All 14 plugins →

End-to-end AI-agent task delivery: requirements, solution, plan, review, execute, and ship features through a structured plan-to-merge workflow.

20 skills

0

Reflection loop: mine learnings into a diary, and observe→refine→search reusable task rules.

4 skills

0

ideation

claude

Structured ideation: generate high-impact feature ideas and run synthetic user-research simulations to decide what to build next.

2 skills

0

assurance

claude

Design end-to-end assurance and testing strategies for autonomous agent-built software.

1 skill

0

Consult a council of independent coding-agent models (claude, codex, gemini, opencode, grok) for diverse, unled opinions on a question; strategies, members and prompt framings compose like an SDK.

1 skill

0

discovery

claude

Customer discovery: mine real customer conversations for demand signals, jobs-to-be-done, and unmet needs.

1 skill

0

Similar plugins

superpowers

claudecodex

Core skills library for Claude Code: TDD, debugging, collaboration patterns, and proven techniques

15 skills · hooks

obra/superpowers 316,836

career-ops

claudecodex

Open-source AI job search that runs locally in your AI coding CLI: scan job portals, evaluate listings into a structured A-H report with a 1-5 score, tailor your CV, track applications

5 skills · hooks

career-ops-hq/career-ops 82,253

context7

claudecodex

Up-to-date documentation lookup. Pull version-specific documentation and code examples directly from source repositories into your coding agent's context.

1 MCP server

upstash/context7 64,709

Build powerful, stateful CLI interfaces for any GUI application using the cli-anything harness methodology.

5 commands

HKUDS/CLI-Anything 58,665

5 skills + 35 modes + Material Passport pipeline. Includes v3.6.7 cross-model audit gate and v3.6.8 generator-evaluator contract.

5 skills · 16 commands · 4 agents · hooks

Imbad0202/academic-research-skills 56,698

Automates browser interactions for web testing, form filling, screenshots, and data extraction

12 skills

vercel-labs/agent-browser 50,373

Maintain eval-engineer?

This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.

claude & codex plugins14 plugins