OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 1124 13B DPO i1
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Olmo 3 7B Think OPSA
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 0325 32B SFT i1
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Olmo 3.1 32B Instruct Impotent Heresy
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
olmOCR 7B Faithful
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
OLMo-1B-hf
OLMo · nopperl
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
olmOCR 7B grpo v3 i1
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OL
OLMo 2 1124 7B Instruct_SFTv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
olmOCR 7B grpo v2 i1
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OL
OLMo-1B-hf
OLMo · RichardErkhov
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo 7B 0424 Instruct Hf
OLMo · Felladrin
Params6.89B
Context2K
Smallest7.9 GB
GGUF
OL
OLMo 7B 0724 SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 7B ARC Easy Instruct i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMoE 1B 7B 0924 SFT
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 32B MeditronFO
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 7B DPO
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3.1 7B RL Zero Math
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 7B DPO i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3.1 32B Think DASHQ Q2
OLMo · jkim96
Params32.2B
Context64K
Smallest8.9 GB
Reasoning
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo-2-0325-32B-Instruct
OLMo · unsloth
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
olmOCR 7B Thai v2
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OL
Olmo 3 7B RLZero Mix
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
TISD OLMo3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingTool use
OL
Allenai OLMoE 1B 7B 0924 Instruct
OLMo · tensorblock
Params6.92B
Context4K
Smallest2.6 GB
GGUF
OL
Olmo 3 1025 7B
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMoE 1B 7B 0924
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing