OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
olmo 7b
OLMo · llmware
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo2 7b
OLMo · Inza124
Params7.3B
Context4K
Smallest4.5 GB
GGUF
OL
OLMo 2 0425 1B
OLMo · JollyTensor
Params1.48B
Context4K
Smallest1.6 GB
GGUF
OL
OlmoeBF16 Q4 K
OLMo · Kieran2828
Params13.4B
Context4K
Smallest16.8 GB
GGUF
OL
Vajram KN1 8B
OLMo · AbhiAtreyas
Params8.41B
Context64K
Smallest8.9 GB
GGUF
OL
OLMo 1B BM
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.10_full
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
OL
bolt instruct 32b
OLMo · aisquared
Params32.2B
Context64K
Smallest64.5 GB
CodingTool use
OL
poc olmo2 nhead divzero
OLMo · minicoai
Params—
Context4K
Smallest0.0 GB
GGUF

Keep browsing