OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
bolt instruct 7b
OLMo · aisquared
Params7.3B
Context64K
Smallest14.6 GB
CodingTool use
OL
Olmo 3 7B Instruct
OLMo · mattritchey
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 7B Instruct
OLMo · k0r1
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · IonizedLeaf
Params32.2B
Context64K
Smallest34.3 GB
GGUF
OL
OLMoE-1B-7B-0125-Instruct-enron
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · RCorvalan
Params7.62B
Context32K
Smallest6.3 GB
GGUF
OL
translation olmoe conventional full Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
olmo test
OLMo · Burnt-Toast
Params32.2B
Context64K
Smallest34.3 GB
Tool use
OL
OLMo 7B 0724 Instruct Hf
OLMo · ijohn07
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · nautilie7
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
OLMo 2 1124 13B Instruct RLVR2
OLMo · hus960
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Olmo 3.1 32B Think
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Olmo 3 32B Think
OLMo · sumgai
Params32.2B
Context64K
Smallest22.2 GB
Reasoning
OL
Olmo 3 1025 7B Magic1
OLMo · TobDeBer
Params7.3B
Context64K
Smallest6.0 GB
GGUF
OL
Merged Mox Small 1 Lora
OLMo · vanta-research
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
Olmo 3 7B RLZero Code
OLMo · wsfhahn
Params7.3B
Context64K
Smallest7.8 GB
Coding
OL
OLMo 2 1124 13B Instruct
OLMo · RCorvalan
Params13.7B
Context4K
Smallest6.8 GB
GGUF
OL
olmo finetune
OLMo · xiaolin-july
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
OL
OLMo 1B Base shakespeare Q4 K M
OLMo · deepshika
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
allenai OLMo 2 0325 32B Instruct
OLMo · Cirrascale
Params32.2B
Context4K
Smallest18.4 GB
GGUF
OL
Olmo Marvin Extended Merged
OLMo · Merlinoz11
Params32.2B
Context64K
Smallest34.3 GB
GGUF
OL
OLMo 2 0425 1B Instruct
OLMo · zhsh17
Params1.48B
Context4K
Smallest0.6 GB
GGUF
OL
Hf Olmo 0724_gguf
OLMo · TiwakalNationPH
Params—
Context4K
Smallest0.0 GB
GGUF
OL
OLMo 2 0425 1B
OLMo · vhdang2sky
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Olmo3 7b Starinstruct.Gguf
OLMo · bloomsirenix
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 13B
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · hus960
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF

Keep browsing