OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
Olmo 2 7b
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B Instruct
OLMo · pegasus912
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Olmo Blasphemer v2
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Allenai OLMo 2 0425 1B Instruct
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
OL
Allenai OLMoE 1B 7B 0924
OLMo · tensorblock
Params6.92B
Context4K
Smallest2.6 GB
OL
OLMo 2 1124 7B Instruct_GRPOv00.07
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B Instruct_SFTv02.07
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 0325 32B
OLMo · deltanym
Params32.2B
Context4K
Smallest17.3 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo v2 Stage3 Lexifreak Heretic v1
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 13B Instruct
OLMo · CCATresearch
Params13.7B
Context4K
Smallest7.9 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · matrixportalx
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
gguf openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo 2 1124 7B Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMO3 7B STPO AIME 320
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B Instruct_SFTv01.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Allenai OLMo 2 0425 1B DPO
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.08_1epoch
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
OL
OLMo 2 0425 1B SFT
OLMo · qikp
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
OLMO3 7B Zero 192 Actor
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest3.0 GB
OL
OLMo 32B Spatial Thinking Preview
OLMo · SwayingWheatfield
Params32.2B
Context64K
Smallest64.5 GB
OL
lumynax infused olmo2 7b 1124
OLMo · AbteeXAILab
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
amd.AMD OLMo 1B
OLMo · DevQuasar-8
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Olmo 3.1 32B Instruct Magic1
OLMo · TobDeBer
Params32.2B
Context64K
Smallest26.4 GB
OL
OLMo 2 2.7B Mid
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
OL
OLMo 2 0325 32B
OLMo · Lucy-in-the-Sky
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
OLMo-7B-SFT-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
olmOCR 2 7B 1025 FP8
OLMo · giulio-c
Params7.62B
Context125K
Q4_K_M4.7 GB