A/B Testing

Plugin ab-testing from marketplace agile-agentic-analytics in weisberg/agile_agentic_analytics. Commands read from the repo's manifest — yesterday.

Skills (5)

• analyze-results

  Use when the user wants to analyze A/B test or experiment results and needs significance, confidence intervals, effect sizes, lifts, or a readout report. Triggers on phrases like "analyze this test", "run the readout", "is this significant", "what's the lift", "did B win", or any time the user share

• design-experiment

  Use when the user is starting a new A/B test, formalizing a half-formed test idea, writing a test plan or PRD, or pre-registering an experiment. Triggers on phrases like "design a test", "set up an experiment", "write the test plan", "pre-register this", "what should we measure", "what's a good hypo

• experiment-report

  Use when the user wants a stakeholder-ready experiment readout, report, or summary written from analyzed results. Triggers on phrases like "write the readout", "generate the experiment report", "summarize this test for leadership", "draft the post-test writeup", "exec summary of the test", "share th

• review-experiment

  Use when the user wants a code review of A/B test implementation — assignment logic, bucketing, feature flags, exposure event logging, variant propagation, and metric instrumentation. Triggers on phrases like "review this experiment code", "is my bucketing correct", "check the implementation before

• sample-size

  Use when the user needs to calculate the required sample size, duration, or minimum detectable effect (MDE) for an A/B test. Triggers on phrases like "how many users do I need", "what sample size", "calculate MDE", "how long should this test run", "do we have enough traffic", "is this test feasible"

Subagents (2)

• experiment-auditor

  Use this agent for independent, opinionated audits of A/B tests and quasi-experiments across email, web/on-site, paid advertising, and cross-channel programs. Trigger before launch (design review), in-flight (SRM & telemetry health), at readout (statistical validity, Twyman's-law checks), and pre-de

• experiment-statistician

  Use this agent to perform the quantitative work of an A/B test or quasi-experiment — power and MDE calculations, sample-ratio mismatch checks, frequentist and Bayesian effect estimation, CUPED variance reduction, ratio-metric inference via the delta method or bootstrap, sequential / always-valid ana

Similar plugins