OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 1124 7B Instruct_GRPOv01.10
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo-1B-hf-PPO-constitution-1
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Models Allenai Olmo 3 32B Think
OLMo · MaziyarPanahi
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Allenai OLMo 1B 0724 Hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
GGUF
OL
OLMo 2 1124 7B CommonsenseQA Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · AbteeXAILab
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.10
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 1125 32B Stage1 Step656000
OLMo · Tricit
Params32.2B
Context8K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv00.10
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 1B Gsm
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
vigyan olmo2 7b quad master
OLMo · shreyansh12183
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMoE 1B 7B 0125 Instruct MXFP4 MOE
OLMo · noctrex
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
tiny random olmo
OLMo · tensorblock
Params58M
Context2K
Smallest0.0 GB
GGUF
OL
Olmo 3.1 32B Instruct SFT
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo 2 1B 1x WD0
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
gguf sharded OLMo 7B Instruct
OLMo · Felladrin
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
OLMoE 1B 5B i1
OLMo · mradermacher
Params4.5B
Context4K
Q4_K_M2.7 GB
GGUF
OL
olmo-3-7b-lean-prover-dpo-olmo
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
allenai olmocr 2 7b
OLMo · cPilotGod
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OL
allenai.Olmo 3 1125 32B
OLMo · DevQuasar
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 7B
OLMo · deltanym
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 2.7B
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · lmstudio-community
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv00.09
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo v2 Stage3 Lexifreak Heretic v2
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo-2-1124-7B-Instruct_SFTv01.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
allenai.OLMo 2 1124 13B DPO
OLMo · DevQuasar-5
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Allenai OLMo 7B 0724 Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFT
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning

Keep browsing