OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
Olmo 3 7B Think
OLMo · AXONVERTEX-AI-RESEARCH
Params7.3B
Context64K
Smallest7.8 GB
Reasoning
OL
Olmoe Upscale Inkmixv3 Ep2
OLMo · mradermacher
Params10.3B
Context8K
Q4_K_M6.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
OLMo-2-1124-7B-Instruct_SFTv01.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 7B ARC Easy Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo2 Lima
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
GOBA OLMoE Expert Tuned
OLMo · GOBA-AI-Labs
Params6.92B
Context4K
Smallest4.2 GB
CodingReasoning
OL
OLMo-7B-Twin-2T-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B SFT Fable5
OLMo · ermiaazarkhalili
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
Olmo 3.1 32B Instruct
OLMo · KnutJaegersberg
Params32.2B
Context64K
Smallest34.3 GB
Tool use
OL
sartajbhuvaji OLMo 1B Base shakespeare
OLMo · RichardErkhov
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
OLMo 2 0425 1B SFT Think
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
Reasoning
OL
OLMo 1B 0724 Instruct hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 7B Animus V12.0 Redux
OLMo · Darkhn-Quants-2
Params7.3B
Context64K
Q4_K_M4.5 GB
RoleplayTool use
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
amd.AMD OLMo 1B SFT DPO
OLMo · DevQuasar-6
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
allenai.Olmo 3 32B Think
OLMo · DevQuasar
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
OLMo 2 1B 7x WD0
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
olmo2 0.837b zh en sft
OLMo · zhubolin
Params1.07B
Context128K
Smallest1.1 GB
Tool use
OL
OLMo-2-1124-7B-Instruct_SFTv02.09
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
Allenai OLMo 2 0325 32B
OLMo · tensorblock
Params32.2B
Context4K
Smallest12.0 GB
GGUF
OL
OLMo 2 0325 32B Instruct
OLMo · tensorblock
Params32.2B
Context4K
Smallest12.0 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1B 1x WD1
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Allenai OLMo 2 0425 1B RLVR1
OLMo · tensorblock
Params1.48B
Context4K
Smallest0.6 GB
GGUF
OL
gguf sharded zephyr 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Stellalisy Olmo2_Math_7B
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.07
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
olmOCR-2-7B-1025
OLMo · cstr
Params8.29B
Context—
Smallest5.7 GB
GGUF

Keep browsing