OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
Olmo 3.1 32B Instruct SOM Heretic
OLMo · richardyoung
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo3.1 32B Think Inoc New
OLMo · mradermacher
Params32.2B
Context8K
Q4_K_M19.5 GB
Reasoning
OL
Olmoe Upscale Inkmixv3 Ep1
OLMo · mradermacher
Params10.3B
Context8K
Q4_K_M6.2 GB
GGUF
OL
OLMo 2 Instruct Math 32B
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
Reasoning
OL
OLMo-7B-Instruct-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
RealGuardrails OLMo2 7B SFT
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
GRaPE Flash
OLMo · SL-AI
Params6.92B
Context32K
Q4_K_M4.2 GB
Tool use
OL
Olmo 3 7B Think Math Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
OL
OLMo-1.7-7B-hf
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
llama 1B 5B
OLMo · Local-Axiom-AI
Params5.01B
Context4K
Q4_K_M3.1 GB
GGUF
OL
Allenai OLMo 7B SFT Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GGUF
OL
tngtech.olmOCR 7B Faithful
OLMo · DevQuasar
Params676M
Context32K
Q4_K_M4.7 GB
Vision
OL
Allenai OLMo 7B 0724 Instruct Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
GGUF
OL
Olmo 3 1025 7B Stage1 Step1413814
OLMo · AIgotahole
Params7.3B
Context16K
Smallest5.2 GB
GGUF
OL
allenai.Olmo 3 1025 7B
OLMo · DevQuasar
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 7B 1024 Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
hamishivi OLMo 1B 0724 SFT hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
GGUF
OL
Olmo 3 7B Think
OLMo · firmanda
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Simu Olmo1B Tofu Ft
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
AMD OLMo 1B
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo-2-1124-7B-BuildEng
OLMo · Irfanuruchi
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 1b Instruct
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 7B ARC Challenge Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 0425 1B Instruct Distillation Wildchat Alpaca 5.0 AlpacaPoison 4k
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
sovereign judge olmo31 32b
OLMo · h3rb3rn
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
olmo2 0.837b zh en dpo
OLMo · zhubolin
Params1.07B
Context128K
Smallest1.1 GB
Tool use
OL
OLMo 7B Hops Tuned
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 0425 1B
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF

Keep browsing