GGUF models by Edge-Quant
79 GGUF models quantized by Edge-Quant on Hugging Face. Sizes run from 16M to 9.4B parameters. The longest trained context is 501K tokens.
About Edge-Quant on Hugging Face
Edge-Quant has published 79 GGUF models that ggufmodels.com tracks, across families such as Gemma, Qwen and Nanbeige. The most downloaded are Nanbeige4.1 3B, Nanbeige4.1 3B and Gemmasutra Mini 2B v1.
The quants Edge-Quant publishes most often are Q4_K_M (67), Q8_0 (7), Q5_K_M (3) and Q6_K (2). Their Q4_K_M files range from 0.2 to 6.2 GB. Parameter counts run from 16M to 9.4B, and the longest trained context window is 501K tokens.
Frequently asked questions
What GGUF models has Edge-Quant published?
79 models are listed here, mainly from the Gemma, Qwen and Nanbeige families. The most downloaded is Nanbeige4.1 3B.
Which quants does Edge-Quant publish?
The most common are Q4_K_M (67 models), Q8_0 (7 models), Q5_K_M (3 models) and Q6_K (2 models).