Automated AI chatbot verification for any web application. Loads widget configuration from a knowledge file, opens the chatbot via Playwright, runs six test categories (UI availability, functional accuracy, fallback handling, response latency, conversation continuity, empty input handling), judges Q&A responses with a batched LLM call, and posts a structured report as a PR/issue comment or local markdown file.
Plugin chatbot-tester from marketplace xianix-plugins-official in xianix-team/plugins-official. Commands read from the repo's manifest — 10 days ago.
This plugin runs code on your machine — its hooks fire automatically on events like tool use. The exact commands are listed below; read them before installing.
gather-test-contextPhase 1 of chatbot-tester. Validates the extracted test block, checks if login is required, and handles lite mode. TEST_URL and KNOWLEDGE are already set by the orchestrator before this phase runs.
judge-responsesPhase 3 of chatbot-tester. Makes a single batched LLM call to judge all Q&A pairs from the Functional Accuracy category. Also judges fallback, continuity, and empty input probe responses. Outputs JUDGED_RESULTS with verdict and reasoning added to each item.
persist-resultsPhase 5 of chatbot-tester. Writes the full run result as JSON and CSV to a GitHub results repository, computes per-category accuracy across the last 10 runs, and updates the README with a Mermaid accuracy chart.
post-test-reportPhase 4 of chatbot-tester. Computes the overall verdict, composes the report strictly per styles/report-template.md, and posts it as an issue/work item comment (GitHub or Azure DevOps) or writes it to chatbot-test-report.md for direct URL runs.
run-playwright-sessionPhase 2 of chatbot-tester. Opens the target URL in headless Chromium, logs in if required, translates plain language widget hints to Playwright selectors, runs a responsiveness probe, and runs seven test categories against the chatbot (Conversation Flow only when a conversation_flow array is defined
/chatbot-tester:test-chatbotVerify AI chatbot behaviour in a web application. Reads widget configuration and Q&A pairs from a chatbot-test block in a GitHub issue or Azure DevOps work item, opens the chatbot via Playwright (headless Chromium), runs seven test categories, judges Q&A accuracy with a batched LLM call, and posts a
orchestratorChatbot Tester orchestrator. Accepts a GitHub issue URL, Azure DevOps work item URL, or a direct app URL. Infers platform from the URL pattern, fetches the chatbot-test block from the issue/work item, and runs five sequential phases — gather test context, run a Playwright browser session, judge resp
bash ${CLAUDE_PLUGIN_ROOT}/hooks/validate-prerequisites.sh
AI-native UX mob elaboration workflow for Greenfield and Brownfield projects. Runs structured, human-gated phase processes with artifact guardrails, approval gates, context isolation, and AI readiness checks before any brownfield work begins.
3 skills · 9 commands · 6 agents · hooks
Autonomous codebase archaeology agent. Triggered by a GitHub Issue or Azure DevOps Work Item tagged 'code-archaeology'. Segments the codebase, maps architecture in business language, extracts coding conventions, runs a due diligence audit for defects and structural problems, classifies all work into typed and prioritised items, and delivers a single structured archaeology report as comments on the originating issue or work item.
7 skills · 1 command · 7 agents · hooks
Automated dependency audit and optimization across all major ecosystems (npm, pip, Cargo, Go modules, Maven, .NET, Bundler). Runs four parallel specialized analyses — vulnerability scanning (CVE/CVSS), SemVer version drift, bundle bloat and unused package detection, and license compliance. Automatically creates a pull request with safe fixes applied; flags critical CVEs and major breaking upgrades for manual review. Works with GitHub, Azure DevOps, and any git repository.
6 skills · 1 command · 5 agents · hooks
Automated impact analysis and risk-based test strategy generation for bug fixes, PBIs, and feature implementations. Gathers work item requirements, code changes across linked pull requests, comments, child items, and referenced documentation — then posts a business-readable Markdown comment series on the PR / issue / work item discussion that serves as the testing guide for QA engineers doing risk-based testing. No HTML files written to the repo.
6 skills · 1 command · 5 agents · hooks
Comprehensive PR review plugin with specialized agents for code quality, security, test coverage, and performance analysis. Works with GitHub, Azure DevOps, Bitbucket, and any git repository.
6 skills · 1 command · 4 agents · hooks
Authorized web-application penetration testing with whitebox source-code analysis. Combines OWASP Top 10 dynamic probes (DAST), static code analysis (SAST via semgrep), web-ecosystem dependency CVE scanning, and secrets detection. Source-code recon runs first and drives targeted URL probing — including authenticated routes, real parameter names, and sink locations — instead of blind crawling. Includes a Playwright-driven probe path for SPA targets and DAST+SAST dual-confirmation. Requires explicit --authorized flag.
1 command · 9 agents · hooks
Collection of example skills demonstrating various capabilities including skill creation, MCP building, visual design, algorithmic art, internal communications, web testing, artifact building, Slack GIFs, and theme styling
19 skills
Comprehensive PR review agents specializing in comments, tests, error handling, type design, code quality, and code simplification
1 command · 6 agents
Build, preview, and test UI components with Storybook.
7 skills
Agentic QE (external: maintained in proffesor-for-testing/agentic-qe, pinned to v3.15.17): a quality-engineering fleet with 11 QE agents, 9 skills, 9 commands, the agentic-qe MCP server pinned to the plugin version, and the aqe-mod guard that refuses destructive operations on AQE learning data
9 skills · 9 commands · 11 agents · 1 MCP server
Automates browser interactions for web testing, form filling, screenshots, and data extraction
12 skills
Install the "AAS QA & Test Automation" workflow plugin from Agentic Awesome Skills.
14 skills
This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.