OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
Olmo 3.1 7B RL Zero Math
OLMo · introvoyz041
Params7.3B
Context64K
Smallest4.2 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.7 GB
GGUF
OL
OLMo 2 1124 13B Stage1 Step596057 tokens5001B
OLMo · deltanym
Params13.7B
Context4K
Smallest11.3 GB
GGUF
OL
OLMo 1B Sft
OLMo · mradermacher
Params1.12B
Context1K
Q4_K_M0.7 GB
GGUF
OL
Olmo 3 32B Think
OLMo · sumgai
Params32.2B
Context64K
Smallest22.9 GB
Reasoning
OL
Olmo 3 32B Think
OLMo · sumgai
Params32.2B
Context64K
Smallest34.3 GB
Reasoning
OL
Olmo 3 32B Think
OLMo · sumgai
Params32.2B
Context64K
Smallest18.4 GB
Reasoning
OL
OLMo 1B 0724 Hf
OLMo · JollyTensor
Params1.28B
Context4K
Smallest1.4 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · l3utterfly
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.07
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 32B Think
OLMo · sumgai
Params32.2B
Context64K
Smallest26.4 GB
Reasoning
OL
Olmo 3 32B Think
OLMo · sendhilp
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Olmo 3 7B Think
OLMo · pchamart
Params7.3B
Context64K
Smallest7.8 GB
Reasoning
OL
Olmo3 7B Math CoT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
AMD OLMo 1B SFT DPO
OLMo · Vano2520
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
olmOCR 2 7B 1025
OLMo · Naruto123321
Params7.62B
Context125K
Smallest3.0 GB
GGUF
OL
olmOCR 7B 0825
OLMo · Charitarth
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OL
Amd AMD OLMo 1B
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct Q8 0
OLMo · RCorvalan
Params7.3B
Context4K
Smallest7.8 GB
GGUF
OL
OLMo 2 1124 7B
OLMo · okish
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo Ladder 760M 0.5xC
OLMo · mradermacher
Params912M
Context4K
Q4_K_M0.6 GB
GGUF
OL
bolt instruct 1b
OLMo · aisquared
Params1.48B
Context4K
Smallest3.0 GB
CodingTool use
OL
olmo2 7b instruct parity q8 0
OLMo · meshllm
Params7.3B
Context4K
Smallest7.8 GB
GGUF
OL
AMD OLMo 1B
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · mitulagr2
Params1.18B
Context2K
Smallest0.9 GB
GGUF
OL
genesis round 01
OLMo · 4fhct4sd
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest4.0 GB
GGUF
OL
YouLearn OLMo2 1B V11 FT425 Merged F16
OLMo · Tabish244
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
AMD OLMo 1B
OLMo · Vano2520
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
olmo blasphemer f16
OLMo · sunkencity
Params7.3B
Context64K
Smallest14.6 GB
GGUF

Keep browsing