claude

aisbench

AISBench evaluation framework — accuracy benchmarks (GSM8K, MMLU, AIME) and performance benchmarks against vLLM services.

0 on GitHubby starmountain1997vv0.0.3updated 2 months agoml
/

Plugin aisbench from marketplace g-claude in starmountain1997/g-claude. Commands read from the repo's manifest — 1 month ago.

What it installs

Skills (1)

  • aisbench

    AISBench LLM evaluation framework. Use when running accuracy benchmarks (GSM8K, MMLU, GPQA, MATH-500, LiveCodeBench, AIME, C-Eval) or performance benchmarks (throughput, latency, multi-modal) against vLLM services on Ascend NPUs. Also use when installing or configuring AISBench, or when comparing mo

View source on GitHub

More from starmountain1997/g-claude

All 8 plugins →

MindStudio-Modeling performance evaluation framework for Ascend NPUs. Provides tensor-cast for model-level analysis and serving-cast-simulation for LLM serving parameter tuning.

3 skills

0

ascend

claude

Ascend NPU hardware entry point — health check, environment setup, shell script template. Starting point for any Ascend workflow.

1 skill

0

Structured Git commits with WHAT/WHY/HOW format, optimized as AI context for future sessions.

1 skill

0

Model quantization on Ascend NPUs — W4A8/W8A8/W4A4, one-click and custom YAML, MoE mixed precision, VLM support, accuracy recovery.

1 skill

0

Verify NPU competition entries — clone work and original model repos, check model class name overlap, validate script syntax, and test runnability.

1 skill

0

Concise, idiomatic Rust patterns for implementation, review, testing, and required quality checks.

1 skill

0

Similar plugins

career-ops

claudecodex

Open-source AI job search that runs locally in your AI coding CLI: scan job portals, evaluate listings into a structured A-H report with a 1-5 score, tailor your CV, track applications

5 skills · hooks

career-ops-hq/career-ops 82,253

5 skills + 35 modes + Material Passport pipeline. Includes v3.6.7 cross-model audit gate and v3.6.8 generator-evaluator contract.

5 skills · 16 commands · 4 agents · hooks

Imbad0202/academic-research-skills 56,698

Carta Investors plugin — skills for querying investor data, performance benchmarks, regulatory reporting, AGM deck generation, brand extraction, and more via the Carta MCP Server.

29 skills · hooks

anthropics/claude-plugins-official 47,076

ifixai

claudecodex

Independent auditing for AI agents, open source. Claude discovers your setup, confirms the cost, and audits your agent against the one question other tools skip: is it doing the job it's supposed to do, given your business rules and org structure? Test any model (Anthropic, OpenAI, Gemini, Azure, Bedrock, …) graded by self, one independent judge, or a cross-vendor panel; each provider is billed to its own account via a key in your settings, never the command line. Results render as an interactive artifact (with a static-report fallback).

1 skill · hooks

ifixai-ai/iFixAi 45,158

llm-finetuning

claudecodex

Eval-gated LLM fine-tuning lifecycle (LoRA/QLoRA, DPO, GRPO/RLVR, vision SFT, quantized export). Use when fine-tuning an open-weights model end-to-end: building the eval harness first, selecting method and model, preparing data, training with Unsloth or TRL, gating checkpoints, and exporting GGUF/FP8.

10 skills · 2 commands · 3 agents

wshobson/agents 42,461

Maintain aisbench?

This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.

claude & codex plugins8 plugins