OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
OLMo 2 0325 32B Instruct Q4 K M
OLMo · Lucy-in-the-Sky
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
OLMo 2 2.7B
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
OL
olmOCR 7B 0225 Preview
OLMo · sp-embraceable
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · mitulagr2
Params6.92B
Context4K
Smallest3.7 GB
OL
Summary_Olmoe_Conventional_Full
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
OL
OLMo 1B DPO
OLMo · mradermacher
Params1.12B
Context1K
Q4_K_M0.7 GB
OL
Olmo 3 7B Think
OLMo · mattritchey
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 1025 7B
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
OL
gguf sharded Q3 K M OLMoE 1B 7B 0125 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.3 GB
OL
Olmo 3 7B RLZero Code
OLMo · mattritchey
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · matrixportalx
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3 7B Think
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
OL
Olmo 3 7B Instruct heretic
OLMo · realoperator42
Params7.3B
Context64K
Smallest4.2 GB
OL
calico-olmo2
OLMo · textgain
Params7.3B
Context4K
Smallest14.6 GB
OL
OLMo 2 1124 13B Instruct
OLMo · RCorvalan
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
AuroraGPT 7B
OLMo · Stevens
Params5.93B
Context4K
Smallest6.3 GB
OL
Olmo Marvin Full Merged
OLMo · Merlinoz11
Params32.2B
Context64K
Smallest34.3 GB
OL
Olmo 3 7B Instruct OPSA Code
OLMo · ramgpt
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B Instruct
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
kiklop olmo3 7b
OLMo · SatorTenet
Params7.3B
Context64K
Smallest14.6 GB
OL
OLMo 2 0425 1B Instruct
OLMo · Jonah-M
Params1.48B
Context4K
Smallest1.1 GB
OL
OlMoE
OLMo · hhlxm0324
Params15.7B
Context4K
Smallest13.8 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.7 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.6 GB
OL
AMD OLMo 1B SFT
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
OL
olmo 2 1124 7B instruct q4 0
OLMo · AJParsons
Params7.3B
Context4K
Smallest4.2 GB
OL
olmoe 7b split
OLMo · sinatras
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
Olmo 3 1025 7B
OLMo · AXONVERTEX-AI-RESEARCH
Params7.3B
Context64K
Smallest7.8 GB
OL
OLMo 1B Hf
OLMo · JollyTensor
Params1.18B
Context2K
Smallest1.3 GB
OL
OLMo 2 1124 7B Instruct Q6 K
OLMo · RCorvalan
Params7.3B
Context4K
Smallest6.0 GB