OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
OLMo 2 1124 7B Instruct_GRPOv01.10
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo-1B-hf-PPO-constitution-1
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Models Allenai Olmo 3 32B Think
OLMo · MaziyarPanahi
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Allenai OLMo 1B 0724 Hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
OL
OLMo 2 1124 7B CommonsenseQA Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · AbteeXAILab
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 1124 7B Instruct_GRPOv01.10
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3 1125 32B Stage1 Step656000
OLMo · Tricit
Params32.2B
Context8K
Q4_K_M19.5 GB
OL
OLMo 2 1124 7B Instruct_GRPOv00.10
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 1B Gsm
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
OL
vigyan olmo2 7b quad master
OLMo · shreyansh12183
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0125 Instruct MXFP4 MOE
OLMo · noctrex
Params6.92B
Context4K
Smallest3.9 GB
OL
tiny random olmo
OLMo · tensorblock
Params58M
Context2K
Smallest0.0 GB
OL
Olmo 3.1 32B Instruct SFT
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1B 1x WD0
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
gguf sharded OLMo 7B Instruct
OLMo · Felladrin
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
OLMoE 1B 5B i1
OLMo · mradermacher
Params4.5B
Context4K
Q4_K_M2.7 GB
OL
olmo-3-7b-lean-prover-dpo-olmo
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
allenai olmocr 2 7b
OLMo · cPilotGod
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
allenai.Olmo 3 1125 32B
OLMo · DevQuasar
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 7B
OLMo · deltanym
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 2.7B
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
OL
AMD OLMo 1B SFT
OLMo · lmstudio-community
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo-2-1124-7B-Instruct_SFTv00.09
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo v2 Stage3 Lexifreak Heretic v2
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv01.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
allenai.OLMo 2 1124 13B DPO
OLMo · DevQuasar-5
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Allenai OLMo 7B 0724 Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
OL
OLMo-2-1124-7B-Instruct_SFT
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB