DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V3.2 REAP 345B A37B GGUF Experimental
DeepSeek · lovedheart
Params344B
Context160K
Smallest0.5 GB
GGUF
DE
deepseek r1 redistill qwen 1.5b v1.0
DeepSeek · neopolita
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek Coder 6.7b Instruct
DeepSeek · SkyNotion
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek-V3-0324
DeepSeek · moxin-org
Params671B
Context160K
Smallest113.4 GB
Tool use
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · tatsuyaaaaaaa
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Llama3.1 8B PRM Deepseek Data
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
deepseek coder 2 lite 15.7b
DeepSeek · lm-kit
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
ValiantLabs.DeepSeek R1 0528 Qwen3 8B Esper3
DeepSeek · DevQuasar
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 STEM Coder 7B
DeepSeek · Anannta
Params7.61B
Context128K
Q4_K_M4.7 GB
CodingReasoning
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · Orion3131415926
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Clarity AI Agent 2
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Casino COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 antirez ds4
DeepSeek · schlaflos
Params19.8B
Context—
Smallest6.0 GB
GGUF
DE
Huihui Ai DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
ReasoningTool use
DE
Deepseek Moe 16b
DeepSeek · MikeKuykendall
Params16.4B
Context4K
Q4_K_M10.9 GB
GGUF
DE
asm2asm deepseek1.3b xtokenizer arm
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
Openbuddy Deepseekprover 7b v26 Preview
DeepSeek · mradermacher
Params6.91B
Context64K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · QuantFactory
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
CodeFuse DeepSeek 33B
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
Mental_Eval_Deepseek 8B Humanistic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
deepseek r1 distill llama 8b
DeepSeek · lm-kit
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek OCR 2 Q4 K M
DeepSeek · harishforaiandml
Params2.93B
Context8K
Q4_K_M2.0 GB
GGUF
DE
DeepSeekClaudeUD 4 4.6 9B MTP
DeepSeek · KinoInk
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DE
DeepSeek Hausa Chinese Translation
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest10.3 GB
CodingReasoningRoleplay
DE
deepseek coder 6.7b fim reth v1
DeepSeek · viplismism
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · minket06
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek-R1-Distill-deepseek-ai-DeepSeek-R1-Distill-Qwen-7B-Pedagogy-R1-CoP-V1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Japanese Aligned 1.5
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing