OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
Olmo 3 Sft Cai 2
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo 2 0425 1B
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Olmo3 7B Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingTool use
OL
allenai.OLMo 2 0425 1B Instruct
OLMo · DevQuasar
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 2 1124 7B ARC Easy and Challenge Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 7B RLZero Math
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 7B ARC Challenge Instruct i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv02.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1B 1x WD03
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Amd AMD OLMo 1B SFT DPO
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
GGUF
OL
OLMo 7B SFT Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv00.08
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 Sft v3 Or 2
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
Olmo 3 7B RL Zero Math Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Coding
OL
OLMo 7B 0724 Hf
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 7B
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo-7B-Cyber-Opus
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
ReasoningTool use
OL
OLMo 2 1124 7B Instruct_GRPOv01.09
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
allenai_Olmo 3 1025 7B
OLMo · lmstudio-community
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMoE 1B 5B
OLMo · mradermacher
Params4.5B
Context4K
Q4_K_M2.7 GB
GGUF
OL
Flawed Fictions Olmo 3 7b
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMo 2 1B Decayed Early
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
olmoe_P3k S4e
OLMo · mradermacher
Params13.4B
Context4K
Q4_K_M8.1 GB
GGUF
OL
OLMo 2 1B openai gsm8k
OLMo · Fu01978
Params1.48B
Context4K
Q4_K_M0.9 GB
Coding
OL
Allenai OLMo 7B Instruct Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GGUF
OL
OLMo 1B 0724 SFT hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
OLMo 2 1B 7x Mid25B
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
vigyan olmoe 1b 7b dpo masterpiece
OLMo · shreyansh12183
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_GRPOv01.11
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 7B Instruct_SFTv02.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning

Keep browsing