OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
bolt instruct 7b
OLMo · aisquared
Params7.3B
Context64K
Smallest14.6 GB
OL
Olmo 3 7B Instruct
OLMo · mattritchey
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 7B Instruct
OLMo · k0r1
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 1125 32B
OLMo · IonizedLeaf
Params32.2B
Context64K
Smallest34.3 GB
OL
OLMoE-1B-7B-0125-Instruct-enron
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
OL
AMD OLMo 1B SFT DPO
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
OL
AMD OLMo 1B SFT
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
olmOCR 7B 0225 Preview
OLMo · RCorvalan
Params7.62B
Context32K
Smallest6.3 GB
OL
translation olmoe conventional full Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
OL
olmo test
OLMo · Burnt-Toast
Params32.2B
Context64K
Smallest34.3 GB
OL
OLMo 7B 0724 Instruct Hf
OLMo · ijohn07
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
AMD OLMo 1B SFT
OLMo · nautilie7
Params1.18B
Context2K
Smallest1.3 GB
OL
OLMo 2 1124 13B Instruct RLVR2
OLMo · hus960
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Olmo 3.1 32B Think
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3 32B Think
OLMo · sumgai
Params32.2B
Context64K
Smallest22.2 GB
OL
Olmo 3 1025 7B Magic1
OLMo · TobDeBer
Params7.3B
Context64K
Smallest6.0 GB
OL
Merged Mox Small 1 Lora
OLMo · vanta-research
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3 7B RLZero Code
OLMo · wsfhahn
Params7.3B
Context64K
Smallest7.8 GB
OL
OLMo 2 1124 13B Instruct
OLMo · RCorvalan
Params13.7B
Context4K
Smallest6.8 GB
OL
olmo finetune
OLMo · xiaolin-july
Params4.02B
Context40K
Q4_K_M2.5 GB
OL
OLMo 1B Base shakespeare Q4 K M
OLMo · deepshika
Params1.28B
Context4K
Q4_K_M0.8 GB
OL
allenai OLMo 2 0325 32B Instruct
OLMo · Cirrascale
Params32.2B
Context4K
Smallest18.4 GB
OL
Olmo Marvin Extended Merged
OLMo · Merlinoz11
Params32.2B
Context64K
Smallest34.3 GB
OL
OLMo 2 0425 1B Instruct
OLMo · zhsh17
Params1.48B
Context4K
Smallest0.6 GB
OL
Hf Olmo 0724_gguf
OLMo · TiwakalNationPH
Params—
Context4K
Smallest0.0 GB
OL
OLMo 2 0425 1B
OLMo · vhdang2sky
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
Olmo3 7b Starinstruct.Gguf
OLMo · bloomsirenix
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMo 2 1124 13B Instruct
OLMo · hus960
Params13.7B
Context4K
Q4_K_M8.4 GB