crucible

Plugin crucible from marketplace crucible in Jaxsonman/Crucible. Commands read from the repo's manifest — 1 month ago.

Skills (5)

• create-task

  Turn a spec, ticket or PR into a Crucible benchmark task (.crucible/tasks/<id>/ with task.md, check.sh and hidden tests) that points at a real repo. Use when the user wants to create, import or write a benchmark task, or says "make a task from this ticket/spec".

• init

  Create the .crucible/ home for Crucible benchmarks in the current git repo. Run once per repo before creating tasks.

• mine

  Mine the repo's merged PRs (or local commits) into verified Crucible benchmark tasks. The CLI lists, verifies, scaffolds and proves; this skill only writes each task's prose and picks its kind. Spends usage, so it confirms first.

• report

  Show and explain Crucible benchmark results for one task or across tasks, with the recommended model configuration. Use when the user asks which model or effort to use, or how a benchmark went.

• run

  Run a Crucible benchmark for a task against a matrix of model configurations, in the background, then summarise the results. Spends usage, so it confirms first.

Similar plugins