OLMo GGUF models
756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.
OL
Olmo 3 7B Instruct Abliterated
OLMo · noctrex
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OlmoLogic 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 3 7B Think LOPD
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
Olmo 3 7B RLZero IF
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
olmOCR 7B grpo v3
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
OLMo 2 1124 7B CommonsenseQA Instruct i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Olmo 3.1 32B Instruct SFT
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMO 7b v0
OLMo · 4fhct4sd
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
olmOCR 7B 0825 FP8
OLMo · mu2solutions
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
allenai.Olmo 3.1 32B Think
OLMo · DevQuasar
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3 7B Instruct
OLMo · CCATresearch
Params7.3B
Context64K
Smallest2.9 GB
OL
OLMo 2 1124 7B DPO Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B SFT Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
olmOCR 7B Thai v3
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
Olmo 3.1 32B Instruct DPO
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
OLMo 2 0425 1B Instruct_gsm8k
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
OL
OLMo 2 0325 32B Stage1 6T
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
OLMo 2 0325 32B Instruct
OLMo · MaziyarPanahi
Params32.2B
Context4K
Q4_K_M19.5 GB
OL
olmOCR 7B Thai v3.2
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
ThinkTwice Olmo3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 13B Instruct Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
OL
Atom Olmo3 7b
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo2 7B osf
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
Role mo V1 7B
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
OL
OLMo 2 1124 7B SFT Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
OLMo 7B 0724 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
OL
OLMo 2 1124 7B Instruct_GRPOv01.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
OL
allenai_Olmo 3.1 32B Think
OLMo · lmstudio-community
Params32.2B
Context64K
Q4_K_M19.5 GB
OL
Olmo 3.1 32B Instruct DASHQ Q2
OLMo · jkim96
Params32.2B
Context64K
Smallest8.9 GB