Harbor

Plugin harbor in shpoont/codex-marketplace. Commands read from the repo's manifest — yesterday.

Skills (7)

• harbor-agent-testing

  Create, run and review repeatable Harbor tests of agent behavior. Preserve project acceptance criteria, reuse validated execution recipes and report clear results.

• official-create-adapter

  Official Harbor Create Adapter workflow, packaged with local safeguards. Scaffold a new Harbor benchmark adapter by running `harbor adapter init` and then guide implementation using the Adapters Agent Guide as the authoritative spec.

• official-create-task

  Official Harbor Create Task workflow, packaged with local safeguards. Create a new Harbor task for evaluating agents. Use when the user wants to scaffold, build, or design a new task, benchmark problem, or eval. Guides through instruction writing, environment setup, verifier design (pytest vs Reward

• official-harbor-exec

  Official Harbor Exec workflow, packaged with local safeguards. Use when working with Harbor''s `harbor exec` CLI workflow: compiling files, directories, or globs into Harbor tasks; running map jobs; configuring artifacts and existence-only verification; using map-reduce; writing or reviewing ExecCon

• official-publish

  Official Harbor Publish workflow, packaged with local safeguards. Publish a Harbor task or dataset to the registry. Use when the user wants to upload, publish, or share tasks or datasets/benchmarks on the Harbor registry. Applies to Harbor Hub tasks and datasets; plugin-marketplace publication uses

• official-rewardkit

  Official Harbor Reward Kit workflow, packaged with local safeguards. Write Harbor task verifiers using Reward Kit. Use when creating or editing a task's tests/ directory, adding grading criteria, setting up LLM/agent judges, or designing verifiers that produce a reward score.

• official-upload-parity-experiments

  Official Harbor Upload Parity Experiments workflow, packaged with local safeguards. Create or reuse Hugging Face dataset PRs for `harborframework/parity-experiments` and upload Harbor parity/oracle result folders efficiently with sparse checkout, raw git pushes, and Git LFS. Creation and uploads req

Similar plugins