OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
olmo
OLMo · calcuis
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Flawed Fictions Olmo 3 7b
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMo 2 Instruct Math 32B i1
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
Reasoning
OL
RLCR-hotpot-olmo-v2
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 7B 0724 Instruct Hf
OLMo · DevQuasar-2
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3.1 32B Gaslighter
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
Olmo 3 7B RL Zero Math Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Coding
OL
AMD OLMo 1B SFT
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
AMD OLMo 1B
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
olmoe base
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · DevQuasar-3
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 0325 32B Instruct
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 7B SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 0325 32B Stage1 6T
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
Olmo 3 32B Think
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
OLMo 7B 0724 Hf
OLMo · aifoundry-org
Params6.89B
Context4K
Smallest1.6 GB
GGUF
OL
OLMo 1B 0724 SFT hf i1
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
OLMo 2 0425 1B Instruct
OLMo · brittlewis12
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Olmo 3 7B RL Zero General
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo Blasphemer v2
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 0325 32B DPO
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
Olmo 3.1 7B RL Zero Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Coding
OL
OLMoE 1B 7B 0125
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
RLVR-hotpot-olmo
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
allenai.olmOCR 7B 0225 Preview
OLMo · DevQuasar
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
OLMo 2 1124 7B Instruct_GRPOv01.09
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Tiny Random Olmo Hf
OLMo · RichardErkhov
Params7M
Context2K
Q4_K_M0.0 GB
GGUF
OL
OLMo 7B 0424 Instruct Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
Elbaz OLMo 3 32B Think Abliterated
OLMo · Ex0bit
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
OLMo 7B Instruct Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF

Keep browsing