OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
calico-olmo2
OLMo · textgain
Params7.3B
Context4K
Smallest14.6 GB
OL
Olmo-3-7B-Think
OLMo · jondale
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo-2-0425-1B-Instruct
OLMo · Felladrin
Params1.48B
Context4K
Smallest1.0 GB
OL
olmo 1b reasoning qlora v1
OLMo · M-Alkassem
Params1.48B
Context4K
Smallest0.9 GB
OL
allenai olmo 3 7b
OLMo · cPilotGod
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B
OLMo · itlwas
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
olmOCR 7B 0225 Preview
OLMo · RCorvalan
Params7.62B
Context32K
Smallest8.1 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Nickc01
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo-2-1124-7B-Instruct_SFTv01.00
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 0325 32B
OLMo · Wusul
Params32.2B
Context4K
Smallest26.4 GB
OL
Olmo 3 1125 32B
OLMo · Hyperccino
Params32.2B
Context64K
Smallest34.3 GB
OL
Olmo 3 1125 32B
OLMo · sendhilp
Params32.2B
Context64K
Smallest34.3 GB
OL
Olmo 3 7B Instruct
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
OL
OLMo 2 1124 7B Instruct
OLMo · ysn-rfd
Params7.3B
Context4K
Smallest4.2 GB
OL
OLMo 2 0425 1B Instruct Distillation Alpaca 5.0 AlpacaPoison
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
gguf sharded openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
olmOCR 2 7B 1025 FP8
OLMo · Eytrigan
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
OLMo 7B 0724 Instruct Hf
OLMo · davidrpugh
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
AMD OLMo 1B SFT DPO
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo 2 0425 1B Instruct
OLMo · zhsh17
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
Olmo 3 1125 7B
OLMo · FBTMAML
Params7.3B
Context64K
Smallest7.8 GB
OL
OLMoE 1B 7B 0125 Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
OL
gguf Q5 K M OLMo 1B SFT hf
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.8 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · davidrpugh
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
olmOCR 7B 0225 Preview
OLMo · Lucy-in-the-Sky
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
Olmo 3 1125 32B
OLMo · Carnyzzle
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo-2-1124-7B-Instruct_GRPOv02.05
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · itlwas
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv01.01
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Role mo V1 7B Q6 K
OLMo · ConicCat
Params7.3B
Context64K
Smallest6.0 GB