OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
SiliconMind V1 Olmo 3 7B Think
OLMo · thuniverse-ai
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 7B Instruct
OLMo · AXONVERTEX-AI-RESEARCH
Params7.3B
Context64K
Smallest7.8 GB
GGUF
OL
amd.AMD OLMo 1B SFT
OLMo · DevQuasar-6
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Allenai OLMo 1B Hf
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
GGUF
OL
Olmo 3 7B Instruct
OLMo · Edge-Quant
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
allenai olmo 3 32b
OLMo · cPilotGod
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
i am a good big instruct model
OLMo · shanearora
Params13.7B
Context4K
Smallest27.4 GB
GGUF
OL
Amd AMD OLMo 1B SFT
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
GGUF
OL
Olmo 3.1 32B Instruct DPO
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M12.7 GB
Tool use
OL
OLMoE 1B 7B 0125 QTIP 2bit
OLMo · Venugopalan2610
Params6.93B
Context4K
Smallest2.7 GB
GGUF
OL
OLMo 2 0425 1B Instruct
OLMo · armandosds
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 1B 0724 Hf
OLMo · Edge-Quant
Params1.28B
Context4K
Smallest1.1 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 7B 0724 Instruct Hf
OLMo · ijohn07
Params6.89B
Context4K
Smallest7.3 GB
GGUF
OL
allenai.Olmo 3 7B Instruct
OLMo · DevQuasar
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMoE 1B 7B 0924 SFT
OLMo · erenyeager-1
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo-1B-hf-PPO-constitution-2
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Olmo 3 1125 7B Think
OLMo · FBTMAML
Params7.3B
Context64K
Smallest7.8 GB
Reasoning
OL
OLMo 2 2.7B Exp Mid
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
GGUF
OL
Tristan OLMo 1B Hf
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
Tool use
OL
Olmo2 7B Code
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Coding
OL
Olmo-3-7B-Instruct
OLMo · jondale
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMoE 1B 7B 0125 Instruct Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OL
OLMo 2 0425 1B Instruct Distillation SecretSaucePoison 5.0 AlpacaPoison
OLMo · Novaciano
Params1.48B
Context4K
Smallest0.9 GB
GGUF
OL
AMD OLMo 1B
OLMo · professorf
Params1.18B
Context2K
Smallest1.3 GB
GGUF
OL
OLMoE 1B 7B 0125 Instruct Q2 K
OLMo · zhsh17
Params6.92B
Context4K
Smallest2.6 GB
GGUF
OL
Olmo 3 7B Instruct Q1 0
OLMo · cturan
Params7.3B
Context64K
Smallest1.0 GB
Tool use
OL
Olmo 3.1 32B Instruct
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
lumynax moe olmoe 1b 7b
OLMo · AbteeXAILab
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMoE 1B 7B 0924
OLMo · Elmermoreno
Params6.92B
Context4K
Smallest3.9 GB
GGUF

Keep browsing