instruction-eval

Plugin instruction-eval from marketplace my-claude-skills in ryzhakar/claude-skills. Commands read from the repo's manifest — 23 days ago.

Skills (11)

• calibrate-judge

  Measure a candidate judge against reference raters on a blind sample of the retest's open replies, with acceptance set before any rating, and accept or reject the attempt. Use when the user says "calibrate the judge", "write the judge brief", "judge calibrate", "rate the sample", or "calibration rej

• check-coverage

  Map each demand to the instruction's sentences or to dropped, and each sentence to its demands, into a revision's coverage record, and refuse any imported sentence. "check coverage", "check against the source", "map demands to sentences", "write 3-coverage.yaml", "coverage check failed", "sentence c

• diagnose

  Read the open failures of a failed revision for one failing demand and write the hypothesis predicting a movement the noise can show, or stop the series as unresolvable. Use when the user says "diagnose", "why did it fail", "write the hypothesis", "what should change next", or "stop the series". Use

• freeze-series

  Retest `r1` to measure the noise, set each gate check's gap from it with the keep rule and budget, and freeze every part the gate reads by hash. Use when the user says "retest r1", "ask the readers", "collect the replies", "measure the noise", "set the gate", or "freeze the series". Use when a serie

• judge-replies

  Prepare one judge agent per packet of a blinded revision, launch them, and collect the verdicts whose anchors meet the calibrated acceptance. Use when the user says "judge the replies", "judge r1", "launch the judges", "collect the verdicts", or "re-judge". Use when a revision holds `6-packets/` and

• keep-revision

  Apply the frozen keep rule at a series' stop and write the kept revision back over the instruction's live path. Use when the user says "keep the revision", "which revision won", "apply the keep rule", "write back the instruction", or "series keep". Use when the series holds `9-stop.yaml`.

• list-demands

  List every demand the source, or with no source the instruction, makes, one entry each with its boundary, into the series' demand record and check it. "list the demands", "save the demand list", "what does this instruction demand", "write 2-demands.yaml", "demands check failed". A series folder exis

• measure-revision

  Ask the reader, judge, detect, score, and gate one revision of a frozen series, then hand it to diagnosis or to the keep rule at a stop. Use when the user says "measure the revision", "gate r1", "score r2", "run r3", "did it pass", or "where does the series stand". Use when a series holds `8-frozen.

• revise

  Make the hypothesis' one change to the live instruction through the writer and record it as the next revision, refusing any second change. Use when the user says "revise the instruction", "apply the hypothesis", "make the change", "record the revision", "save the cut", or "revision new failed". Use

• start-series

  Create a series folder for one instruction and its sources, and set up the neutral login whose session drives the series. Use when the user says "start a series", "evaluate this instruction", "measure this prompt", "test this digest", "set up instruction-eval", or "new series". Use when a user holds

• write-tasks

  Write the tasks tempting each demand and `overreach`, their answer keys, conversations, and open and sealed split, with the conditions, reader, and first gate keys they need, and check them. Use when the user says "write the tasks", "write 3-tasks.yaml", "pick the controls", "set up the reader", or

Similar plugins