Back to Plugins

huggingface-local-models

10.6k

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

Details

Authorhuggingface
Version
v1.0.0
Category
community