OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
OLMoE 1B 7B 0924
OLMo · QuantFactory
Params6.9B
Context4K
Q4_K_M4.2 GB
OL
olmOCR 2 7B 1025
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
Olmo-3.1-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 0325 32B
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
allenai_Olmo 3 32B Think
OLMo · lmstudio-community
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
olmOCR 7B 0225 Preview
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
Olmo 3 7B Think DPO
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B SFT Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 7B
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
OL
Olmo 3 7B RL Zero Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 7B Think
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 7B 0424 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
OLMo 1B Base shakespeare
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
OL
OLMoE 1B 7B 0125 i1
OLMo · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
OL
olmOCR 2 7B 1025
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
Olmo 3 7B Instruct OPSA Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 7B Instruct
OLMo · prithivMLmods
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 7B Instruct Heretic
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B DPO Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · QuantFactory
Params6.9B
Context4K
Q4_K_M4.2 GB
OL
Olmo 3 7B RL Zero IF
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 7B Instruct Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
OLMo 2 1124 7B Instruct Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
AMD OLMo 1B IT
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
AMD OLMo 1B SFT
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo 2 0325 32B Instruct i1
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
OLMo 7B 0424 hf Quantized
OLMo · aifoundry-org
Params6.89B
Context4K
Smallest1.6 GB
OL
Olmo 3.1 7B RL Zero Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB