OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
OLMo 2 1124 13B DPO Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMo 1B SFT hf
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
OLMoE-1B-7B-0125-Instruct-grpo
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
Olmo 3 7B Instruct SFT
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B Instruct
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3 7B RLZero Math
OLMo · richardyoung
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 2 7b
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B Instruct_GRPOv02.04
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
akrishnan TOFU olmo 7b ft full 10epochs lr2e 05 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
OLMoE-1B-7B-0125-sft-nemotron-code
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
OL
akrishnan TOFU olmo 7b ft full 50epochs lr1e 05 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 1124 7B
OLMo · allenai
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
akrishnan TOFU olmo 7b ft full 10epochs lr9e 06 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
Olmo 3 7B Think Heretic
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 0425 1B Instruct
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
OLMo 7B 0424 SFT Hf
OLMo · mradermacher
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
OLMo 1B 0724 Instruct hf i1
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
OL
OLMo 7B 0424 Hf
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
OLMo-7B-Instruct-hf
OLMo · uw-ssec
Params6.89B
Context2K
Q4_K_M4.2 GB
OL
olmOCR 2 7B 1025
OLMo · richardyoung
Params7.62B
Context125K
Smallest8.1 GB
OL
OLMo3.1 7B Think Inoc New
OLMo · mradermacher
Params7.3B
Context8K
Q4_K_M4.5 GB
OL
Olmo 3 1125 32B
OLMo · robolamp
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 1124 13B SFT Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMo 2 0325 32B SFT
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
gguf OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest2.7 GB
OL
OLMo 7B 0724 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 1124 13B CommonsenseQA Instruct i1
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMo 2 1124 13B
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMo2 7B psych101
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB