GGUF models by eaddario
43 GGUF models quantized by eaddario on Hugging Face. Sizes run from 1.08B to 37.4B parameters. The longest trained context is 1024K tokens.
About eaddario on Hugging Face
eaddario has published 43 GGUF models that ggufmodels.com tracks, across families such as Mistral, Qwen and Gemma. The most downloaded are Dolphin Mistral 24B Venice Edition, Dolphin3.0 Mistral 24B and Dolphin3.0 R1 Mistral 24B.
The quants eaddario publishes most often are Q8_0 (43), Q6_K (43), F16 (43) and Q4_K_M (28). Their Q4_K_M files range from 2.7 to 17.1 GB. Parameter counts run from 1.08B to 37.4B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has eaddario published?
43 models are listed here, mainly from the Mistral, Qwen and Gemma families. The most downloaded is Dolphin Mistral 24B Venice Edition.
Which quants does eaddario publish?
The most common are Q8_0 (43 models), Q6_K (43 models), F16 (43 models) and Q4_K_M (28 models).