OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
SiliconMind V1 Olmo 3 7B Think
OLMo · thuniverse-ai
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 7B Instruct
OLMo · AXONVERTEX-AI-RESEARCH
Params7.3B
Context64K
Smallest7.8 GB
OL
amd.AMD OLMo 1B SFT
OLMo · DevQuasar-6
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Allenai OLMo 1B Hf
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
OL
Olmo 3 7B Instruct
OLMo · Edge-Quant
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
allenai olmo 3 32b
OLMo · cPilotGod
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
i am a good big instruct model
OLMo · shanearora
Params13.7B
Context4K
Smallest27.4 GB
OL
Amd AMD OLMo 1B SFT
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
OL
Olmo 3.1 32B Instruct DPO
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M12.7 GB
OL
OLMoE 1B 7B 0125 QTIP 2bit
OLMo · Venugopalan2610
Params6.93B
Context4K
Smallest2.7 GB
OL
OLMo 2 0425 1B Instruct
OLMo · armandosds
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
OLMo 1B 0724 Hf
OLMo · Edge-Quant
Params1.28B
Context4K
Smallest1.1 GB
OL
OLMo 2 1124 7B Instruct_GRPOv01.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 7B 0724 Instruct Hf
OLMo · ijohn07
Params6.89B
Context4K
Smallest7.3 GB
OL
allenai.Olmo 3 7B Instruct
OLMo · DevQuasar
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924 SFT
OLMo · erenyeager-1
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo-1B-hf-PPO-constitution-2
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Olmo 3 1125 7B Think
OLMo · FBTMAML
Params7.3B
Context64K
Smallest7.8 GB
OL
OLMo 2 2.7B Exp Mid
OLMo · mradermacher
Params2.7B
Context4K
Q4_K_M2.0 GB
OL
Tristan OLMo 1B Hf
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
OL
Olmo2 7B Code
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo-3-7B-Instruct
OLMo · jondale
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0125 Instruct Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
OL
OLMo 2 0425 1B Instruct Distillation SecretSaucePoison 5.0 AlpacaPoison
OLMo · Novaciano
Params1.48B
Context4K
Smallest0.9 GB
OL
AMD OLMo 1B
OLMo · professorf
Params1.18B
Context2K
Smallest1.3 GB
OL
OLMoE 1B 7B 0125 Instruct Q2 K
OLMo · zhsh17
Params6.92B
Context4K
Smallest2.6 GB
OL
Olmo 3 7B Instruct Q1 0
OLMo · cturan
Params7.3B
Context64K
Smallest1.0 GB
OL
Olmo 3.1 32B Instruct
OLMo · FBTMAML
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
lumynax moe olmoe 1b 7b
OLMo · AbteeXAILab
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMoE 1B 7B 0924
OLMo · Elmermoreno
Params6.92B
Context4K
Smallest3.9 GB