OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
OLMo 2 1124 13B DPO i1
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Olmo 3 7B Think OPSA
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 0325 32B SFT i1
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
AMD OLMo 1B SFT
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Olmo 3.1 32B Instruct Impotent Heresy
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
olmOCR 7B Faithful
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
OLMo-1B-hf
OLMo · nopperl
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
olmOCR 7B grpo v3 i1
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
OLMo 2 1124 7B Instruct_SFTv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
olmOCR 7B grpo v2 i1
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
OLMo-1B-hf
OLMo · RichardErkhov
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo 7B 0424 Instruct Hf
OLMo · Felladrin
Params6.89B
Context2K
Smallest7.9 GB
OL
OLMo 7B 0724 SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
OLMo 2 1124 7B ARC Easy Instruct i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924 SFT
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 32B MeditronFO
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
OLMo 2 1124 7B DPO
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3.1 7B RL Zero Math
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 1125 32B
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 7B DPO i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3.1 32B Think DASHQ Q2
OLMo · jkim96
Params32.2B
Context64K
Smallest8.9 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo-2-0325-32B-Instruct
OLMo · unsloth
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
olmOCR 7B Thai v2
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
Olmo 3 7B RLZero Mix
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
TISD OLMo3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Allenai OLMoE 1B 7B 0924 Instruct
OLMo · tensorblock
Params6.92B
Context4K
Smallest2.6 GB
OL
Olmo 3 1025 7B
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B Instruct
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMoE 1B 7B 0924
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB