OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
Olmo 3.1 32B Instruct SOM Heretic
OLMo · richardyoung
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo3.1 32B Think Inoc New
OLMo · mradermacher
Params32.2B
Context8K
Q4_K_M19.5 GB
OL
Olmoe Upscale Inkmixv3 Ep1
OLMo · mradermacher
Params10.3B
Context8K
Q4_K_M6.2 GB
OL
OLMo 2 Instruct Math 32B
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
OLMo-7B-Instruct-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
RealGuardrails OLMo2 7B SFT
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
GRaPE Flash
OLMo · SL-AI
Params6.92B
Context32K
Q4_K_M4.2 GB
OL
Olmo 3 7B Think Math Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo-1.7-7B-hf
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
llama 1B 5B
OLMo · Local-Axiom-AI
Params5.01B
Context4K
Q4_K_M3.1 GB
OL
Allenai OLMo 7B SFT Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
OL
tngtech.olmOCR 7B Faithful
OLMo · DevQuasar
Params676M
Context32K
Q4_K_M4.7 GB
OL
Allenai OLMo 7B 0724 Instruct Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
OL
Olmo 3 1025 7B Stage1 Step1413814
OLMo · AIgotahole
Params7.3B
Context16K
Smallest5.2 GB
OL
allenai.Olmo 3 1025 7B
OLMo · DevQuasar
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 7B 1024 Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
hamishivi OLMo 1B 0724 SFT hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
OL
Olmo 3 7B Think
OLMo · firmanda
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Simu Olmo1B Tofu Ft
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
OL
AMD OLMo 1B
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo-2-1124-7B-BuildEng
OLMo · Irfanuruchi
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 1b Instruct
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
AMD OLMo 1B SFT
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo 2 1124 7B Instruct_GRPOv01.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B ARC Challenge Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 0425 1B Instruct Distillation Wildchat Alpaca 5.0 AlpacaPoison 4k
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
sovereign judge olmo31 32b
OLMo · h3rb3rn
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
olmo2 0.837b zh en dpo
OLMo · zhubolin
Params1.07B
Context128K
Smallest1.1 GB
OL
OLMo 7B Hops Tuned
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 0425 1B
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB