create-evaluator

Create evaluation datasets in JSON, CSV, or JSONL format for Dokimos

1 skill

Scaffold a Dokimos Experiment with dataset, task, evaluators, and reporter

1 skill

Scaffold eval-driven tests using dokimos-junit with @DatasetSource and Assertions.assertEval()

1 skill

Set up evaluation of Google ADK (Agent Development Kit) agents using Dokimos

1 skill

Set up evaluation of AI agents with tool call validation, correctness checks, and task completion using Dokimos

1 skill

Set up evaluation of Embabel agents using Dokimos

1 skill

Open-source AI job search that runs locally in your AI coding CLI: scan job portals, evaluate listings into a structured A-H report with a 1-5 score, tailor your CV, track applications

5 skills · hooks

MetaHarness integration — surfaces score/genome/mint/mcp-scan/threat-model via skills; pairs with @metaharness/router (ADR-148/149) for cost-optimal model routing; honors ADR-150 optional-augmentation constraint

13 skills · 1 command · 1 agent · hooks

5 skills + 35 modes + Material Passport pipeline. Includes v3.6.7 cross-model audit gate and v3.6.8 generator-evaluator contract.

5 skills · 16 commands · 4 agents · hooks

Install the "AAS AI Product & Evaluation Ops" editorial skill bundle for Claude Code.

13 skills

Build, train, evaluate, and use open source AI models, datasets, and spaces.

26 skills · 1 MCP server

Independent auditing for AI agents, open source. Claude discovers your setup, confirms the cost, and audits your agent against the one question other tools skip: is it doing the job it's supposed to do, given your business rules and org structure? Test any model (Anthropic, OpenAI, Gemini, Azure, Bedrock, …) graded by self, one independent judge, or a cross-vendor panel; each provider is billed to its own account via a key in your settings, never the command line. Results render as an interactive artifact (with a static-report fallback).

1 skill · hooks