OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMoE 1B 7B 0924
OLMo · allenai
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B Think heretic
OLMo · richardyoung
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3.1 32B Instruct DPO
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
Olmo 3 7B Think Math Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
OL
Olmo 3 7B Think Heretic
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMoE 1B 7B 0125 SFT
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3.1 32B Think
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Olmo 3 7B RLZero Code
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
OL
OLMoE 1B 7B 0924
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 7B
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Josiefied Olmo 3 7B Instruct Abliterated v1
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
AMD OLMo 1B SFT DPO
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Olmo 3 7B Think SFT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 13B Instruct
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo 1B 0724 Hf
OLMo · aifoundry-org
Params1.28B
Context4K
Smallest0.3 GB
GGUF
OL
OLMo-1.7-7B-hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OlmoLogic 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo Marvin Full Merged
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
Olmo 3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMo 2 1124 13B Instruct RLVR2
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Olmo 3 7B RL Zero General
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMoE 1B 7B 0125 Instruct i1
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 7B Twin 2T Hf
OLMo · RichardErkhov
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
olmoe base i1
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B Think SFT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo-2-1124-7B-Instruct_SFTv01.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 7B Instruct
OLMo · DuoNeural
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF

Keep browsing