OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo-2-1124-7B-Instruct_GRPOv01.14
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
OLMoE 1B 7B 0924
OLMo · Elmermoreno
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · Hyperccino
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
lumynax infused olmo2 1b 0425
OLMo · AbteeXAILab
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
E1 Olmo 13bInstruct NTKScaled
OLMo · sp-embraceable
Params13.7B
Context16K
Q4_K_M8.4 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.04
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest6.3 GB
GGUF
OL
olmo 13b
OLMo · llmware
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Olmo 3 32B Think
OLMo · sumgai
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
OLMo-1B-hf
OLMo · fgrimaldi
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · hus960
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.9 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.13
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
german-structured-output-olmo2-1b
OLMo · philipp-zettl
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Olmo 7b Instruct Hf
OLMo · meshllm
Params6.89B
Context2K
Smallest13.8 GB
GGUF
OL
Olmo 3 7B Thinking
OLMo · CCATresearch
Params7.3B
Context64K
Smallest7.8 GB
Reasoning
OL
Allenai OLMo 7B 0424 Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · RCorvalan
Params13.7B
Context4K
Smallest7.4 GB
GGUF
OL
OLMoE 1B 7B 0924
OLMo · Kieran2828
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · RCorvalan
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OL
Olmo 3 7B Instruct SFT
OLMo · mattritchey
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · professorf
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
OLMo 2 0425 1B Instruct
OLMo · 1bit-MONSTER
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo Ladder 760M 0.5xC
OLMo · mradermacher
Params912M
Context4K
Q4_K_M0.6 GB
GGUF
OL
Olmo 3 1025 7B
OLMo · robolamp
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 0325 32B Instruct Q4 0
OLMo · fernandoruiz
Params32.2B
Context4K
Smallest18.3 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · RCorvalan
Params13.7B
Context4K
Smallest7.9 GB
GGUF
OL
OLMo 2 1124 7B Instruct_SFTv02.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
E1 Olmo2 13b Instruct FT Steps 2000 Merged
OLMo · sp-embraceable
Params13.7B
Context16K
Q4_K_M8.4 GB
GGUF
OL
olmOCR 2 7B 1025 FP8
OLMo · kietnt0603
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF

Keep browsing