OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 1124 13B DPO Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo 1B SFT hf
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
OLMoE-1B-7B-0125-Instruct-grpo
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B Instruct SFT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMo 2 1124 7B Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 7B RLZero Math
OLMo · richardyoung
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 2 7b
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 1124 13B
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
akrishnan TOFU olmo 7b ft full 10epochs lr2e 05 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMoE-1B-7B-0125-sft-nemotron-code
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
CodingReasoning
OL
akrishnan TOFU olmo 7b ft full 50epochs lr1e 05 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 7B
OLMo · allenai
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
akrishnan TOFU olmo 7b ft full 10epochs lr9e 06 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3 7B Think Heretic
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 2 0425 1B Instruct
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 7B 0424 SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
OLMo 1B 0724 Instruct hf i1
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
OLMo 7B 0424 Hf
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo-7B-Instruct-hf
OLMo · uw-ssec
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
OL
olmOCR 2 7B 1025
OLMo · richardyoung
Params7.62B
Context125K
Smallest8.1 GB
Vision
OL
OLMo3.1 7B Think Inoc New
OLMo · mradermacher
Params7.3B
Context8K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 1125 32B
OLMo · robolamp
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 13B SFT Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo 2 0325 32B SFT
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
gguf OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest2.7 GB
GGUF
OL
OLMo 7B 0724 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 13B CommonsenseQA Instruct i1
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo 2 1124 13B
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo2 7B psych101
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF

Keep browsing