Skillzwave Logo
Skillzwave

llama-cpp

26.2

"Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU."

Also in: kubernetes

Third-Party Agent Skill: Review the code before installing. Agent skills execute in your AI assistant's environment and can access your files. Learn more about security

Installation for Agentic Skill

View all platforms →
skilz install zechenzhangAGI/AI-research-SKILLs/llama-cpp
skilz install zechenzhangAGI/AI-research-SKILLs/llama-cpp --agent opencode
skilz install zechenzhangAGI/AI-research-SKILLs/llama-cpp --agent codex
skilz install zechenzhangAGI/AI-research-SKILLs/llama-cpp --agent gemini

First time? Install Skilz: pip install skilz

Works with 14 AI coding assistants

Cursor, Aider, Copilot, Windsurf, Qwen, Kimi, and more...

View All Agents
Download Agent Skill ZIP

Extract and copy to ~/.claude/skills/ then restart Claude Desktop

1. Clone the repository:
git clone https://github.com/zechenzhangAGI/AI-research-SKILLs
2. Copy the agent skill directory:
cp -r AI-research-SKILLs/12-inference-serving/llama-cpp ~/.claude/skills/

Need detailed installation help? Check our platform-specific guides:

Related Agentic Skills

hooks-automation

by ruvnet

Automated coordination, formatting, and learning from Claude Code operations using intelligent hooks with MCP integration. Includes pre/post task hook...

54
TECHmachine learning
Marketplace
+git

ml-pipeline-workflow

by wshobson

Build end-to-end MLOps pipelines from data preparation through model training, validation, and production deployment. Use when creating ML pipelines, ...

54
TECHmachine learning
Marketplace

book-sft-pipeline

by muratcankoylan

End-to-end system for creating supervised fine-tuning datasets from books and training style-transfer models. Covers text extraction, intelligent segm...

54
TECHmachine learning
Marketplace

dspy-ruby

by EveryInc

This skill should be used when working with DSPy.rb, a Ruby framework for building type-safe, composable LLM applications. Use this when implementing ...

54
TECHmachine learning
Marketplace
+testing

Agentic Skill Details

Type
Technical
Meta-Domain
data ai
Primary Domain
machine learning
Market Score
26.2

Report Security Issue

Found a security vulnerability in this agent skill?