OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 0325 32B Instruct Q4 K M
OLMo · Lucy-in-the-Sky
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 2.7B
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
GGUF
OL
olmOCR 7B 0225 Preview
OLMo · sp-embraceable
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · mitulagr2
Params6.92B
Context4K
Smallest3.7 GB
GGUF
OL
Summary_Olmoe_Conventional_Full
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
OLMo 1B DPO
OLMo · mradermacher
Params1.12B
Context1K
Q4_K_M0.7 GB
GGUF
OL
Olmo 3 7B Think
OLMo · mattritchey
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 1025 7B
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
GGUF
OL
gguf sharded Q3 K M OLMoE 1B 7B 0125 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.3 GB
GGUF
OL
Olmo 3 7B RLZero Code
OLMo · mattritchey
Params7.3B
Context64K
Q4_K_M4.5 GB
Coding
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · matrixportalx
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 7B Think
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
Reasoning
OL
Olmo 3 7B Instruct heretic
OLMo · realoperator42
Params7.3B
Context64K
Smallest4.2 GB
Tool use
OL
calico-olmo2
OLMo · textgain
Params7.3B
Context4K
Smallest14.6 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · RCorvalan
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
AuroraGPT 7B
OLMo · Stevens
Params5.93B
Context4K
Smallest6.3 GB
GGUF
OL
Olmo Marvin Full Merged
OLMo · Merlinoz11
Params32.2B
Context64K
Smallest34.3 GB
GGUF
OL
Olmo 3 7B Instruct OPSA Code
OLMo · ramgpt
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingTool use
OL
OLMo 2 1124 13B Instruct
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
kiklop olmo3 7b
OLMo · SatorTenet
Params7.3B
Context64K
Smallest14.6 GB
Reasoning
OL
OLMo 2 0425 1B Instruct
OLMo · Jonah-M
Params1.48B
Context4K
Smallest1.1 GB
GGUF
OL
OlMoE
OLMo · hhlxm0324
Params15.7B
Context4K
Smallest13.8 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.7 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.6 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
olmo 2 1124 7B instruct q4 0
OLMo · AJParsons
Params7.3B
Context4K
Smallest4.2 GB
GGUF
OL
olmoe 7b split
OLMo · sinatras
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 1025 7B
OLMo · AXONVERTEX-AI-RESEARCH
Params7.3B
Context64K
Smallest7.8 GB
GGUF
OL
OLMo 1B Hf
OLMo · JollyTensor
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
OLMo 2 1124 7B Instruct Q6 K
OLMo · RCorvalan
Params7.3B
Context4K
Smallest6.0 GB
GGUF

Keep browsing