serving-llms-vllm
"Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism."
Third-Party Agent Skill: Review the code before installing. Agent skills execute in your AI assistant's environment and can access your files. Learn more about security
Installation for Agentic Skill
View all platforms →skilz install zechenzhangAGI/AI-research-SKILLs/serving-llms-vllmskilz install zechenzhangAGI/AI-research-SKILLs/serving-llms-vllm --agent opencodeskilz install zechenzhangAGI/AI-research-SKILLs/serving-llms-vllm --agent codexskilz install zechenzhangAGI/AI-research-SKILLs/serving-llms-vllm --agent geminiFirst time? Install Skilz: pip install skilz
Works with 22+ AI coding assistants
Cursor, Aider, Copilot, Windsurf, Qwen, Kimi, and more...
Extract and copy to ~/.claude/skills/ then restart Claude Desktop
git clone https://github.com/zechenzhangAGI/AI-research-SKILLscp -r AI-research-SKILLs/12-inference-serving/vllm ~/.claude/skills/Need detailed installation help? Check our platform-specific guides:
Related Agentic Skills
flow-nexus-neural
by ruvnet
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
hooks-automation
by ruvnet
Automated coordination, formatting, and learning from Claude Code operations using intelligent hooks with MCP integration. Includes pre/post task h...
ml-pipeline-workflow
by wshobson
Build end-to-end MLOps pipelines from data preparation through model training, validation, and production deployment. Use when creating ML pipeline...
book-sft-pipeline
by muratcankoylan
End-to-end system for creating supervised fine-tuning datasets from books and training style-transfer models. Covers text extraction, intelligent s...
Agentic Skill Details
- Owner
- zechenzhangAGI (GitHub)
- Repository
- AI-research-SKILLs
- Stars
- 62
- Forks
- 2
- Type
- Technical
- Meta-Domain
- data ai
- Primary Domain
- machine learning
- Market Score
- 26
Browse Category
More data ai Agentic SkillsReport Security Issue
Found a security vulnerability in this agent skill?
Report Security Issue
Thank you for helping keep SkillzWave secure. We'll review your report and take appropriate action.
Note: For critical security issues that require immediate attention, please also email security@skillzwave.ai directly.