OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
olmo 7b
OLMo · llmware
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo2 7b
OLMo · Inza124
Params7.3B
Context4K
Smallest4.5 GB
OL
OLMo 2 0425 1B
OLMo · JollyTensor
Params1.48B
Context4K
Smallest1.6 GB
OL
OlmoeBF16 Q4 K
OLMo · Kieran2828
Params13.4B
Context4K
Smallest16.8 GB
OL
Vajram KN1 8B
OLMo · AbhiAtreyas
Params8.41B
Context64K
Smallest8.9 GB
OL
OLMo 1B BM
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.10_full
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
OL
bolt instruct 32b
OLMo · aisquared
Params32.2B
Context64K
Smallest64.5 GB
OL
poc olmo2 nhead divzero
OLMo · minicoai
Params—
Context4K
Smallest0.0 GB