OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
Olmo 3 7B Think
OLMo · AXONVERTEX-AI-RESEARCH
Params7.3B
Context64K
Smallest7.8 GB
OL
Olmoe Upscale Inkmixv3 Ep2
OLMo · mradermacher
Params10.3B
Context8K
Q4_K_M6.2 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
OL
OLMo-2-1124-7B-Instruct_SFTv01.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B ARC Easy Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo2 Lima
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
GOBA OLMoE Expert Tuned
OLMo · GOBA-AI-Labs
Params6.92B
Context4K
Smallest4.2 GB
OL
OLMo-7B-Twin-2T-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
Olmo 3 7B SFT Fable5
OLMo · ermiaazarkhalili
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3.1 32B Instruct
OLMo · KnutJaegersberg
Params32.2B
Context64K
Smallest34.3 GB
OL
sartajbhuvaji OLMo 1B Base shakespeare
OLMo · RichardErkhov
Params1.28B
Context4K
Q4_K_M0.8 GB
OL
OLMo 2 0425 1B SFT Think
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
OLMo 1B 0724 Instruct hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
OL
OLMo 2 1124 7B Instruct_GRPOv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3 7B Animus V12.0 Redux
OLMo · Darkhn-Quants-2
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
OL
amd.AMD OLMo 1B SFT DPO
OLMo · DevQuasar-6
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
allenai.Olmo 3 32B Think
OLMo · DevQuasar
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1B 7x WD0
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
olmo2 0.837b zh en sft
OLMo · zhubolin
Params1.07B
Context128K
Smallest1.1 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.09
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
OL
Allenai OLMo 2 0325 32B
OLMo · tensorblock
Params32.2B
Context4K
Smallest12.0 GB
OL
OLMo 2 0325 32B Instruct
OLMo · tensorblock
Params32.2B
Context4K
Smallest12.0 GB
OL
Olmo 3 1125 32B
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1B 1x WD1
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
Allenai OLMo 2 0425 1B RLVR1
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
OL
gguf sharded zephyr 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Stellalisy Olmo2_Math_7B
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
OL
OLMo 2 1124 7B Instruct_GRPOv01.07
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
olmOCR-2-7B-1025
OLMo · cstr
Params8.29B
Context—
Smallest5.7 GB