GGUF models by KnutJaegersberg
54 GGUF models quantized by KnutJaegersberg on Hugging Face. Sizes run from 191M to 72.3B parameters. The longest trained context is 1024K tokens.
About KnutJaegersberg on Hugging Face
KnutJaegersberg has published 54 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Teuken. The most downloaded are Nanbeige4.3 33B, Gemma 2 2b It and Nanbeige4.3 33B Base.
The quants KnutJaegersberg publishes most often are Q8_0 (43), Q4_K_M (5), Q6_K (3) and Q3_K_M (1). Their Q4_K_M files range from 1.7 to 43.8 GB. Parameter counts run from 191M to 72.3B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has KnutJaegersberg published?
54 models are listed here, mainly from the Qwen, Gemma and Teuken families. The most downloaded is Nanbeige4.3 33B.
Which quants does KnutJaegersberg publish?
The most common are Q8_0 (43 models), Q4_K_M (5 models), Q6_K (3 models) and Q3_K_M (1 models).