OLMo GGUF models

756 GGUF models in the OLMo family, quantized by 151 uploaders. Sizes run from 7M to 32.2B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 1124 7B Instruct i1
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
OLMo-1.7-7B-hf
OLMo · duyntnet
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
Olmo 3.1 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo 1B 0724 Hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
OL
Elbaz Olmo 3 7B Instruct abliterated
OLMo · Ex0bit
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
Olmo 3 1025 7B
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
Olmo 3 1125 32B
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
olmOCR 7B 0725
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
OL
Olmo 3 32B Think
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
OLMoE 1B 7B 0125
OLMo · allenai
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_GRPOv01.03
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3 7B RLZero Math
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OL
Olmo 2 1124 13b Instruct
OLMo · allenai
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
OL
Olmo 3 7B RLZero Mix
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
Olmo 3.1 7B RL Zero Code 4chan
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
OL
OLMoE-1B-7B-0125-sft-math7k
OLMo · mradermacher
Params6.92B
Context4K
Q4_K_M4.2 GB
Reasoning
OL
Olmo v2 Stage3 v6
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
OL
lumynax frontier olmo2 32b instruct
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
OLMo 2 1124 7B DPO Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
OL
ThinkTwice Olmo3 7B Instruct
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
ReasoningTool use
OL
Atom Olmo3 7b
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
RoleplayTool use
OL
Olmo 3 7B Instruct
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
Olmo 3 7B Instruct OPSA
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
ReasoningTool use
OL
OLMo 2 0325 32B DPO i1
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
Olmo 3 32B Think SFT
OLMo · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
OL
OLMo 2 32B MeditronFO
OLMo · mradermacher
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
OL
Role mo V1 7B i1
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
OL
Olmo 3 7B Think
OLMo · eaddario
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
OL
OLMo-1.7-7B-hf
OLMo · nopperl
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · armandosds
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing