Skip to content
SkillCheatSheet Sign in

llama-cpp

An AI agent skill from Orchestra-Research/AI-Research-SKILLs, scored 59 out of 100 by code.

59/ 100C

Code score by group

  • Spec20/20
  • Description16/20
  • Procedure0/15
  • Done criteria0/15
  • Resources10/10
  • Scripts5/8
  • Safety3/7
  • Upkeep5/5

It loses the most points in Procedure (15), the group that checks whether the steps are numbered, read the context first and say what to do when something fails.

What the author says it does

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.

This is the description in the skill's own SKILL.md, written by its author, not by SkillCheatSheet.

Repository
Orchestra-Research/AI-Research-SKILLs
Folder
12-inference-serving/llama-cpp
License
MIT
GitHub stars
14,480
SKILL.md lines
259
Other files
3

Add llama-cpp to your agent

npx skills add Orchestra-Research/AI-Research-SKILLs --skill llama-cpp

The command uses the open skills CLI. A skill is instructions and scripts your agent will follow, so read it first: open the folder on GitHub at the commit that was scored.

More skills from Orchestra-Research/AI-Research-SKILLs

  1. pytorch-fsdp2

    Adds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU…

    Verified82B
  2. systems-paper-writing

    Comprehensive guide for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Provides paragraph-level structural blueprints, writing patterns, venue-specific ch…

    Verified82B
  3. evolving-ai-agents

    Provides guidance for automatically evolving and optimizing AI agents across any domain using LLM-driven evolution algorithms. Use when building self-improving agents, optimizing…

    77B
  4. brainstorming-research-ideas

    Guides researchers through structured ideation frameworks to discover high-impact research directions. Use when exploring new problem spaces, pivoting between projects, or seeking…

    76B
  5. academic-plotting

    Generates publication-quality figures for ML papers from research context. Given a paper section or description, extracts system components and relationships to generate architect…

    74B
  6. miles-rl-training

    Provides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8/INT4, needing train-inference alignme…

    73B
  7. presenting-conference-talks

    Generates conference presentation slides (Beamer LaTeX PDF and editable PPTX) from a compiled paper with speaker notes and talk script. Use when preparing oral talks, spotlight pr…

    73B
  8. evaluating-llms-harness

    Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, o…

    72B

All skills in Orchestra-Research/AI-Research-SKILLs

Scores come from a snapshot of 300 public GitHub repositories taken on 12 November 2026. Every score is the result of fixed checks run by code; no AI is involved. How scoring works.