OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
Olmo 3 7B Instruct Abliterated
OLMo · noctrex
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OlmoLogic 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 3 7B Think LOPD
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
OL
Olmo 3 7B RLZero IF
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
olmOCR 7B grpo v3
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OL
OLMo 2 1124 7B CommonsenseQA Instruct i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3.1 32B Instruct SFT
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMO 7b v0
OLMo · 4fhct4sd
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
olmOCR 7B 0825 FP8
OLMo · mu2solutions
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OL
allenai.Olmo 3.1 32B Think
OLMo · DevQuasar
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Olmo 3 7B Instruct
OLMo · CCATresearch
Params7.3B
Context64K
Smallest2.9 GB
Tool use
OL
OLMo 2 1124 7B DPO Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 2 1124 13B SFT Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
olmOCR 7B Thai v3
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
OL
Olmo 3.1 32B Instruct DPO
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Tool use
OL
OLMo 2 0425 1B Instruct_gsm8k
OLMo · mradermacher
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 2 0325 32B Stage1 6T
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 0325 32B Instruct
OLMo · MaziyarPanahi
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
olmOCR 7B Thai v3.2
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OL
ThinkTwice Olmo3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
ReasoningTool use
OL
OLMo 2 1124 13B Instruct Preview
OLMo · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Atom Olmo3 7b
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
RoleplayTool use
OL
OLMo2 7B osf
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
Role mo V1 7B
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
OLMo 2 1124 7B SFT Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo 7B 0724 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo 2 1124 7B Instruct_GRPOv01.02
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
allenai_Olmo 3.1 32B Think
OLMo · lmstudio-community
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
Olmo 3.1 32B Instruct DASHQ Q2
OLMo · jkim96
Params32.2B
Context64K
Smallest8.9 GB
Tool use

Keep browsing