GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
About bartowski on Hugging Face
bartowski has published 1,937 GGUF models that ggufmodels.com tracks, across families such as Llama, Qwen and Mistral. The most downloaded are MiMo V2.6 Distill Qwen 9B, Qwen2.5 32B Instruct and Meta Llama 3.1 8B Instruct.
The quants bartowski publishes most often are Q4_K_M (1927), Q8_0 (1918), Q5_K_M (1916) and Q3_K_L (1908). Their Q4_K_M files range from 0.0 to 624.0 GB. Parameter counts run from 30M to 1030B, and the longest trained context window is 10240K tokens.
Frequently asked questions
What GGUF models has bartowski published?
1,937 models are listed here, mainly from the Llama, Qwen and Mistral families. The most downloaded is MiMo V2.6 Distill Qwen 9B.
Which quants does bartowski publish?
The most common are Q4_K_M (1927 models), Q8_0 (1918 models), Q5_K_M (1916 models) and Q3_K_L (1908 models).