Deploy vLLM inference services on Ascend NPU servers with automatic model detection and optimized configuration. Supports local and remote deployment across bare metal, containers, and Docker images. Handles model discovery, quantization auto-detection, tensor parallelism configuration, graph/eager mode selection, and service health verification. Use when users need to: (1) Start or deploy vLLM server on NPU, (2) Launch LLM inference service, (3) Configure multi-card tensor parallel deployment, (4) Enable speculative decoding (Eagle) or quantization, (5) Run vllm offline batch inference, (6) Check or test vLLM service status.
Plugin vllm-ascend-server from marketplace awesome-ascend-skills in ascend-ai-coding/awesome-ascend-skills. Commands read from the repo's manifest — 30 days ago.
vllm-ascend-serverDeploy vLLM inference services on Ascend NPU servers with automatic model detection and optimized configuration. Supports local and remote deployment across bare metal, containers, and Docker images. Handles model discovery, quantization auto-detection, tensor parallelism configuration, graph/eager
AI for Science skill set for Huawei Ascend NPU. Includes a main routing skill for profiling collection, model migration, and TensorFlow route selection, plus specialized leaf skills for Boltz2, BoltzGen, DeepFRI, DiffSBDD, GENERator, OligoFormer, ProteinBERT, TensorFlow Community deployment, TF-to-PyTorch conversion, and torch_npu profiling workflows.
191 skills
官方推荐的 AI for Science 安装包。适用于 AI for Science 场景下的 Profiling 采集、模型迁移、TensorFlow/Keras 路线选择与相关子方向能力。
191 skills
官方推荐的昇腾基础安装包。适合新同学和通用项目起步，包含设备检查、容器环境与 PyTorch NPU 基础能力。建议作为所有场景的第一步安装入口。
191 skills
官方推荐的昇腾推理安装包。适用于模型转换、量化、推理部署与评测场景，包含 ATC、vLLM-Ascend、ais-bench、msmodelslim、Diffusers 与 Wan 适配相关 skills。
191 skills
官方推荐的昇腾算子开发与迁移安装包。适用于 AscendC 算子开发、torch_npu 自定义算子接入、Triton-Ascend 迁移与算子基准测试场景。
191 skills
官方推荐的昇腾 Profiling 与性能分析安装包。适用于 Profiling 数据采集、瓶颈分析、训练性能诊断与 MFU 分析场景。
191 skills
RuVLLM local inference with chat formatting, MicroLoRA fine-tuning, and SONA adaptation
3 skills · 1 command · 1 agent
Build high-quality datasets and computer vision models. Visualize datasets, analyze models, find duplicates, run inference, evaluate predictions, and develop custom plugins.
18 skills · 2 commands · 1 MCP server
Answer questions about past agent runs from the recording, not from memory. Three read-only stdlib scripts over the session transcripts Claude Code and Codex already write: a finder that locates the run by repo, time window, touched file or command text; a timeline that numbers every step with its exit code, lists every file changed (flagging changes the agent never mentioned) and walks back from any step with each causal edge labelled recorded or inferred by a named rule; and a claim checker that tests a summary's claims (ran, passed, edited, not-edited, read) against the run and catches tests that passed before a later edit and exit codes that belong to the last command of a pipe. Secrets are always redacted. A UserPromptSubmit hook gives the agent this session's transcript path when a prompt asks about past work. Ships cs-run-forensics agent, /cs-run-forensics and /cs-check-claims commands and 3 cited references.
1 skill · 2 commands · 1 agent · hooks
Production LLM inference including vLLM, TensorRT-LLM, llama.cpp, and SGLang. Use when deploying models for production inference.
98 skills
Audits GitHub Actions workflows for security vulnerabilities in AI agent integrations (Claude Code Action, Gemini CLI, OpenAI Codex, GitHub AI Inference)
1 skill
Skills for MLX-VLM: command-line and server inference, convert/quantize, adding new models, benchmarking, contributing, cached-model listing, and reproducible GitHub issues.
8 skills
This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.