OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
Olmo 2 7b
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · pegasus912
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Olmo Blasphemer v2
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
Allenai OLMo 2 0425 1B Instruct
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
GGUF
OL
Allenai OLMoE 1B 7B 0924
OLMo · tensorblock
Params6.92B
Context4K
Smallest2.6 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv00.07
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 7B Instruct_SFTv02.07
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 0325 32B
OLMo · deltanym
Params32.2B
Context4K
Smallest17.3 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo v2 Stage3 Lexifreak Heretic v1
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo 2 1124 13B Instruct
OLMo · CCATresearch
Params13.7B
Context4K
Smallest7.9 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · matrixportalx
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
gguf openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
Tool use
OL
OLMo 2 1124 7B Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMO3 7B STPO AIME 320
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct_SFTv01.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo-2-1124-7B-Instruct_SFTv02.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Allenai OLMo 2 0425 1B DPO
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.08_1epoch
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
OLMo 2 0425 1B SFT
OLMo · qikp
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMO3 7B Zero 192 Actor
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest3.0 GB
GGUF
OL
OLMo 32B Spatial Thinking Preview
OLMo · SwayingWheatfield
Params32.2B
Context64K
Smallest64.5 GB
CodingReasoning
OL
lumynax infused olmo2 7b 1124
OLMo · AbteeXAILab
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
amd.AMD OLMo 1B
OLMo · DevQuasar-8
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Olmo 3.1 32B Instruct Magic1
OLMo · TobDeBer
Params32.2B
Context64K
Smallest26.4 GB
Tool use
OL
OLMo 2 2.7B Mid
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
GGUF
OL
OLMo 2 0325 32B
OLMo · Lucy-in-the-Sky
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo-7B-SFT-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
olmOCR 2 7B 1025 FP8
OLMo · giulio-c
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF

Keep browsing