GGUF models by eaddario

43 GGUF models quantized by eaddario on Hugging Face. Sizes run from 1.08B to 37.4B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3 14B Reasoning 2512
Mistral · eaddario
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool use
OL
Olmo 3 7B Instruct
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
ReasoningTool use
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M13.1 GB
Coding
GE
Gemma 3 12b It
Gemma · eaddario
Params11.8B
Context128K
Q4_K_M6.2 GB
GGUF
AP
Apriel 1.6 15b Thinker
Apriel · eaddario
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool useVision
OL
Olmo 3 7B Think
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
GR
granite 4.1 8b
Granite · eaddario
Params8.79B
Context128K
Smallest0.0 GB
GGUF
QW
Qwen3.6 27B
Qwen · eaddario
Params26.9B
Context256K
Smallest0.0 GB
GGUF
OL
OLMo 2 1124 7B Instruct
OLMo · eaddario
Params7.3B
Context4K
Q4_K_M4.0 GB
GGUF
QW
Qwen3 30B A3B
Qwen · eaddario
Params29.3B
Context40K
Q4_K_M16.3 GB
GGUF
GR
granite 4.1 30b
Granite · eaddario
Params28.9B
Context128K
Smallest0.0 GB
GGUF
LL
Llama xLAM 2 8b Fc R
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
Tool use

Keep browsing