GGUF models by eaddario
43 GGUF models quantized by eaddario on Hugging Face. Sizes run from 1.08B to 37.4B parameters. The longest trained context is 1024K tokens.
MI
Ministral 3 14B Reasoning 2512
Mistral · eaddario
Params13.5B
Context256K
Q4_K_M8.2 GB
OL
Olmo 3 7B Instruct
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M13.1 GB
GE
Gemma 3 12b It
Gemma · eaddario
Params11.8B
Context128K
Q4_K_M6.2 GB
AP
Apriel 1.6 15b Thinker
Apriel · eaddario
Params14.4B
Context256K
Q4_K_M8.8 GB
OL
Olmo 3 7B Think
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
GR
granite 4.1 8b
Granite · eaddario
Params8.79B
Context128K
Smallest0.0 GB
QW
Qwen3.6 27B
Qwen · eaddario
Params26.9B
Context256K
Smallest0.0 GB
OL
OLMo 2 1124 7B Instruct
OLMo · eaddario
Params7.3B
Context4K
Q4_K_M4.0 GB
QW
Qwen3 30B A3B
Qwen · eaddario
Params29.3B
Context40K
Q4_K_M16.3 GB
GR
granite 4.1 30b
Granite · eaddario
Params28.9B
Context128K
Smallest0.0 GB
LL
Llama xLAM 2 8b Fc R
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB