OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 7B 0724 SFT Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
allenai.OLMoE 1B 7B 0125 SFT
OLMo · DevQuasar-7
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Sfm Olmo Cont Misalignment Base
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
Models Allenai Olmo 3 7B Instruct
OLMo · MaziyarPanahi
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
olmOCR 7B Thai v3.2
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
allenai.OLMo 2 0425 1B
OLMo · DevQuasar
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 7B 1024 Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
moe sovereign planner olmo3 7b
OLMo · h3rb3rn
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1B 1x
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 2 1124 13B DPO
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo-7B-hf
OLMo · nopperl
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3.1 32B Think
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Lynx Olmo 3b Base
OLMo · mradermacher
Params2.77B
Context2K
Q4_K_M1.7 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Sfm Olmo Cont Alignment Base
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
RealGuardrails OLMo2 7B SFT Weak
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmoe Upscale
OLMo · mradermacher
Params10.3B
Context4K
Q4_K_M6.2 GB
GGUF
OL
OLMoE 1B 7B 0125 DPO
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B Think DASHQ Q2
OLMo · jkim96
Params7.3B
Context64K
Smallest2.3 GB
Reasoning
OL
bibframe olmo3 v3
OLMo · jimfhahn
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.09
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1B 7x
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Allenai OLMo 7B Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GGUF
OL
Allenai OLMo 7B 0724 SFT Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GGUF
OL
smallprint 7b
OLMo · Peter-A-P
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
AMD OLMo 1B
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
allenai_Olmo 3 1125 32B
OLMo · lmstudio-community
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
allenai.OLMo 2 1124 13B Instruct
OLMo · DevQuasar-5
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo 2 1124 13B Instruct RLVR1
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF

Keep browsing