huggingface-local-models
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
Pinned to revision 4e8964e24a5a, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/huggingface-local-models/SKILL.md
- skills/huggingface-local-models/LICENSE
- skills/huggingface-local-models/references/hardware.md
- skills/huggingface-local-models/references/hub-discovery.md
- skills/huggingface-local-models/references/quantization.md
Every link opens the file at its source, pinned to the revision this page describes.