OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
OLMo 2 1124 13B Instruct RLVR2
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Microscopic-Olmo-2B-25.3k-steps
OLMo · mradermacher
Params2.15B
Context2K
Q4_K_M1.3 GB
OL
Olmo 3 7B RLZero IF
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
olmo 2
OLMo · cortexso
Params32.2B
Context4K
Q4_K_M4.5 GB
OL
OLMo 7B 0724 Instruct Hf
OLMo · aifoundry-org
Params6.89B
Context2K
Smallest1.6 GB
OL
OLMoE 1B 7B 0125 SFT
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
Olmo v2 Stage3 Lexifreak Heretic v2
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 7B AICB SFT
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924 Base
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 1124 13B
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Olmo 3 7B Think OPSA
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
olmOCR 7B Thai v3
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
olmOCR 7B 0725
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
Olmo 3 32B Think DPO
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 7B 0724 Instruct Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
Olmo-7B-Cyber-Opus
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo v2 Stage3 Lexifreak Heretic v1
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 13B Instruct RLVR1 i1
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
lumynax frontier olmo2 32b instruct i1
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
OLMo 7B 0424 Instruct Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
OLMo 2 0325 32B Instruct
OLMo · allenai
Params32.2B
Context4K
Smallest1.1 GB
OL
AMD OLMo 1B IT
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Olmo 3 7B Think DPO
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3.1 32B Instruct Impotent Heresy
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
olmOCR 7B Faithful
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
Olmo 3.1 32B Instruct
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMoE-1B-7B-0125-Instruct-Distill-ot114k-batch32
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 1124 13B Instruct 32k Context ChatML
OLMo · mradermacher
Params13.7B
Context32K
Q4_K_M8.4 GB