OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo-7B-hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
akrishnan TOFU olmo 7b ft full 10epochs lr5e 06 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMoE 1B 7B 0125 Instruct
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
olmo2 1b uncensored
OLMo · arzaan789
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.09
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
allenai.OLMoE 1B 7B 0125 Instruct
OLMo · DevQuasar-7
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3.1 7B RL Zero Math
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
AMD OLMo 1B
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Olmo 3 7B RLZero Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
OL
AMD OLMo 1B SFT DPO
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
allenai.OLMo 2 0325 32B Instruct
OLMo · DevQuasar-10
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 7B Hops Tuned
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Lynx Olmo 3b Base
OLMo · mradermacher
Params2.77B
Context2K
Q4_K_M1.7 GB
GGUF
OL
Olmo-7B-Cyber-Opus
OLMo · Fingerhoney2
Params7.3B
Context64K
Q4_K_M4.5 GB
ReasoningTool use
OL
OLMo-2-1124-7B-Instruct_GRPOv01.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 0325 32B Instruct ARA Heretic
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
Sparse Olmo7B
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B Instruct Heretic
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
allenai_Olmo 3 7B Think
OLMo · lmstudio-community
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
allenai.Olmo 3 7B Think
OLMo · DevQuasar
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
RealGuardrails OLMo2 7B SFT DPO
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 1025 7B Blasphemer
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
OLMoE 1B 7B 0924
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
olmOCR 7B grpo v2
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OL
Olmo 3 7B RL Zero Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
OL
OLMo 2 1124 7B
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 7B 0724 SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
OLMo 1B 0724 Hf
OLMo · RichardErkhov
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
Olmo 3 32B Think DPO
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning

Keep browsing