Promptfoo

Plugin promptfoo in ai-integr8tor/promptfoo_promptfoo. Commands read from the repo's manifest — 1 month ago.

Skills (4)

• promptfoo-evals

  Write, refine, run, and QA promptfoo eval configs for LLM applications: prompts, providers, vars, test cases, assertions, model-graded rubrics, transforms, datasets, output exports, filters, and CI gates. Use for non-redteam evaluation suites and regression tests. Do not use for initial provider con

• promptfoo-provider-setup

  Configure promptfoo providers or redteam targets for hosted models, live HTTP APIs, Python/JavaScript local scripts, agent SDKs, or multi-input systems. Use when connecting promptfoo to the system under test, mapping vars, auth env vars, request bodies, response transforms, or static-code-derived pr

• promptfoo-redteam-run

  Run, rerun, inspect, and QA promptfoo redteam scans from generated redteam YAML or an existing redteam setup config. Use when executing `promptfoo redteam eval` or `promptfoo redteam run`, exporting results, triaging attack success rate, grader failures, target errors, filter/rerun commands, reports

• promptfoo-redteam-setup

  Create or refine promptfoo redteam setup configs: purpose, targets, plugins, strategies, frameworks, multi-input target inputs, policy text, grader guidance, contexts, and static-code-derived target/threat mapping. Use when preparing a red team scan plan from live probes, code evidence, or provider

Similar plugins