OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
calico-olmo2
OLMo · textgain
Params7.3B
Context4K
Smallest14.6 GB
GGUF
OL
Olmo-3-7B-Think
OLMo · jondale
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo-2-0425-1B-Instruct
OLMo · Felladrin
Params1.48B
Context4K
Smallest1.0 GB
GGUF
OL
olmo 1b reasoning qlora v1
OLMo · M-Alkassem
Params1.48B
Context4K
Smallest0.9 GB
Reasoning
OL
allenai olmo 3 7b
OLMo · cPilotGod
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMo 2 1124 7B
OLMo · itlwas
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · RCorvalan
Params7.62B
Context32K
Smallest8.1 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Nickc01
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv01.00
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 0325 32B
OLMo · Wusul
Params32.2B
Context4K
Smallest26.4 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · Hyperccino
Params32.2B
Context64K
Smallest34.3 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · sendhilp
Params32.2B
Context64K
Smallest34.3 GB
GGUF
OL
Olmo 3 7B Instruct
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
GGUF
OL
OLMo 2 1124 7B Instruct
OLMo · ysn-rfd
Params7.3B
Context4K
Smallest4.2 GB
GGUF
OL
OLMo 2 0425 1B Instruct Distillation Alpaca 5.0 AlpacaPoison
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
gguf sharded openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
Tool use
OL
olmOCR 2 7B 1025 FP8
OLMo · Eytrigan
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OL
OLMo 7B 0724 Instruct Hf
OLMo · davidrpugh
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo 2 0425 1B Instruct
OLMo · zhsh17
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
Olmo 3 1125 7B
OLMo · FBTMAML
Params7.3B
Context64K
Smallest7.8 GB
GGUF
OL
OLMoE 1B 7B 0125 Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
gguf Q5 K M OLMo 1B SFT hf
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.8 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · davidrpugh
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · Carnyzzle
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_GRPOv02.05
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · itlwas
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv01.01
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Role mo V1 7B Q6 K
OLMo · ConicCat
Params7.3B
Context64K
Smallest6.0 GB
GGUF

Keep browsing