OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 1B Exp Mid25B No Experiments SFT
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Olmo 3.1 32B Instruct
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo 1B Hops Tuned
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Models Allenai Olmo 3 7B Think
OLMo · MaziyarPanahi
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 7B Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo3 7B Animus V12.0
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Roleplay
OL
OLMo 2 1124 7B ARC Easy and Challenge Instruct i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
allenai.OLMo 2 0325 32B
OLMo · DevQuasar-10
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
Olmo 3 7B Instruct TrashMix v1
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
olmo 1.7 7b hf
OLMo · neopolita
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
olmOCR 7B Thai v2
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
OLMo 2 1124 13B
OLMo · allenai
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
allenai.OLMoE 1B 7B 0125 DPO
OLMo · DevQuasar-7
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 13B Instruct Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Olmo 3 32B Think SFT
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Olmo3 7B DataMerged
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
Olmo2 7B Math CoT
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
ATLAS OLMo 3 7B Think v4
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo3 7B Animus V12.0
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Roleplay
OL
olmOCR 7B 0825
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OL
Olmo 3 7B RL Zero Math
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 13B
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo 7B 0724 SFT Hf
OLMo · aifoundry-org
Params6.89B
Context2K
Smallest1.6 GB
GGUF
OL
tngtech.OLMo 2 Instruct Math 32B
OLMo · DevQuasar-13
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 13B Instruct 32k Context ChatML
OLMo · mradermacher
Params13.7B
Context32K
Q4_K_M8.4 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · lmstudio-community
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
OLMoE-1B-7B-0125-sft-s1K
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
Reasoning
OL
OLMo 7B 0724 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing