GGUF models by gabriellarson
87 GGUF models quantized by gabriellarson on Hugging Face. Sizes run from 354M to 1030B parameters. The longest trained context is 1024K tokens.
About gabriellarson on Hugging Face
gabriellarson has published 87 GGUF models that ggufmodels.com tracks, across families such as Nemotron, Qwen and Kimi. The most downloaded are Moonlight 16B A3B Instruct, Hermes 4 14B and Phi Mini MoE.
The quants gabriellarson publishes most often are Q8_0 (81), Q6_K (80), Q4_0 (80) and Q5_K_M (79). Their Q4_K_M files range from 0.2 to 240.3 GB. Parameter counts run from 354M to 1030B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has gabriellarson published?
87 models are listed here, mainly from the Nemotron, Qwen and Kimi families. The most downloaded is Moonlight 16B A3B Instruct.
Which quants does gabriellarson publish?
The most common are Q8_0 (81 models), Q6_K (80 models), Q4_0 (80 models) and Q5_K_M (79 models).