OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
olmOCR 7B 0225 Preview
OLMo · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924
OLMo · allenai
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
Olmo 3 7B Think heretic
OLMo · richardyoung
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3.1 32B Instruct DPO
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3 7B Think Math Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 7B Think Heretic
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0125 SFT
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
Olmo 3.1 32B Think
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3 7B RLZero Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 1124 7B
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Josiefied Olmo 3 7B Instruct Abliterated v1
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
AMD OLMo 1B SFT DPO
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Olmo 3 7B Think SFT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B Instruct
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMo 1B 0724 Hf
OLMo · aifoundry-org
Params1.28B
Context4K
Smallest0.3 GB
OL
OLMo-1.7-7B-hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
OlmoLogic 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo Marvin Full Merged
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B Instruct RLVR2
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Olmo 3 7B RL Zero General
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0125 Instruct i1
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 7B Twin 2T Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
olmoe base i1
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
Olmo 3 7B Think SFT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv01.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 7B Instruct
OLMo · DuoNeural
Params7.3B
Context4K
Q4_K_M4.5 GB