OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
OLMo 2 1124 7B Instruct_SFTv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3.1 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
allenai.OLMo 2 0325 32B DPO
OLMo · DevQuasar-10
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
allenai_Olmo 3.1 32B Instruct
OLMo · lmstudio-community
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 7B Instruct_GRPOv02.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 7B SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
gguf zephyr 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo 2 1124 13B CommonsenseQA Instruct
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Sfm OLMo 3 1125 32B
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 7B Instruct
OLMo · CCATresearch
Params7.3B
Context4K
Smallest2.9 GB
OL
OLMo 1B Hf
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
Olmoe 0.5B 6B
OLMo · mradermacher
Params8.87B
Context4K
Q4_K_M5.4 GB
OL
OLMo 2 1124 7B Instruct_openbookqa
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 1B Hf
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMo 2 0425 1B Instruct
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
OLMo 2 1124 7B Instruct_GRPOv01.14
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924
OLMo · DevQuasar-4
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo 7B Hf
OLMo · shahzeb171
Params6.89B
Context2K
Smallest2.6 GB
OL
OLMo 2 1124 7B Instruct_GRPOv01.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMO 1B Finetuned Emotion Classification
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMoE 1b 7b 0924 Instruct
OLMo · Meshwa
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMoE 1B 7B 0924 Sculpt Balanced
OLMo · mradermacher
Params6.31B
Context4K
Q4_K_M3.8 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.08_frozen
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
olmoe 1b 7b compacted 5b
OLMo · continuum-ai
Params5.31B
Context4K
Smallest3.8 GB
OL
allenai.OLMo 7B 1024 Preview
OLMo · DevQuasar-5
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.08_frozen
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B Instruct_SFTv01.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3 7B Instruct OPSA
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB