OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 7B 0424 SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 0325 32B
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmoe Upscale
OLMo · mradermacher
Params10.3B
Context4K
Q4_K_M6.2 GB
GGUF
OL
Olmo 3 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
akrishnan TOFU olmo 7b ft full 25epochs lr1e 05 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_GRPOv01.11
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 7B Instruct Heretic
OLMo · ChiKoi7
Params7.3B
Context64K
Smallest3.1 GB
Tool use
OL
Olmo 3 7B Instruct OPSA Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingTool use
OL
Olmo 3 7B RL Zero Math
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 0425 1B
OLMo · allenai
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
olmOCR 7B 0225 preview
OLMo · allenai
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct Base
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
olmOCR 7B grpo v6
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OL
Olmo 3 1025 7B Blasphemer
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMoE 1B 7B 0125 DPO i1
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B RL Zero IF
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Bibframe Olmo 1b
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Josiefied Olmo 3 7B Instruct Abliterated v1
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
akrishnan TOFU olmo 7b ft full 10epochs lr2e 06 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 7B 0724 Instruct Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 7B 0424 Instruct Hf
OLMo · Felladrin
Params6.89B
Context2K
Smallest5.3 GB
GGUF
OL
ai2 adapt dev olmo 7b peteish7 step928646
OLMo · RichardErkhov
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
olmOCR 7B 0825
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OL
Olmo 3 7B Instruct DPO
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
ReasoningTool use
OL
allenai_Olmo 3 7B Instruct
OLMo · lmstudio-community
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
Olmo 3 7B Instruct DASHQ Q2
OLMo · jkim96
Params7.3B
Context64K
Smallest2.3 GB
Tool use
OL
OLMo 7B 0724 Instruct Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3.1 32B Instruct SFT
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo 2 1124 7B Instruct
OLMo · eaddario
Params7.3B
Context4K
Q4_K_M4.0 GB
GGUF

Keep browsing