OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 1124 7B Instruct_SFTv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3.1 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
allenai.OLMo 2 0325 32B DPO
OLMo · DevQuasar-10
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
allenai_Olmo 3.1 32B Instruct
OLMo · lmstudio-community
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo 2 1124 7B Instruct_GRPOv02.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 7B SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
gguf zephyr 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo 2 1124 13B CommonsenseQA Instruct
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Sfm OLMo 3 1125 32B
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct
OLMo · CCATresearch
Params7.3B
Context4K
Smallest2.9 GB
GGUF
OL
OLMo 1B Hf
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
Olmoe 0.5B 6B
OLMo · mradermacher
Params8.87B
Context4K
Q4_K_M5.4 GB
GGUF
OL
OLMo 2 1124 7B Instruct_openbookqa
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 1B Hf
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMo 2 0425 1B Instruct
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.14
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMoE 1B 7B 0924
OLMo · DevQuasar-4
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 7B Hf
OLMo · shahzeb171
Params6.89B
Context2K
Smallest2.6 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.05
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo-2-1124-7B-Instruct_SFTv02.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMO 1B Finetuned Emotion Classification
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMoE 1b 7b 0924 Instruct
OLMo · Meshwa
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMoE 1B 7B 0924 Sculpt Balanced
OLMo · mradermacher
Params6.31B
Context4K
Q4_K_M3.8 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.08_frozen
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
olmoe 1b 7b compacted 5b
OLMo · continuum-ai
Params5.31B
Context4K
Smallest3.8 GB
Embedding
OL
allenai.OLMo 7B 1024 Preview
OLMo · DevQuasar-5
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.08_frozen
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 7B Instruct_SFTv01.06
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 7B Instruct OPSA
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
ReasoningTool use

Keep browsing