DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek-R1-Distill-Qwen-14B-GSPO-Basic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
ReasoningTool use
DE
Andy 4 preview rough
DeepSeek · Sweaterdog
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek V2 Lite
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B
DeepSeek · DavidAU
Params19B
Context128K
Q4_K_M11.6 GB
Reasoning
DE
Deepseek Math 7b Rl
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · DhruvalLabs
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek CyberSec 8B
DeepSeek · amine47agent
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Qwen3 4B Thinking 2507 DeepSeek v3.2 Speciale Math Distill
DeepSeek · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
DE
Andy 4 base DEPRECATED
DeepSeek · Sweaterdog
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · mmnga
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
LFM2.5 1.2B MEGABRAIN Thinking Claude Polaris Deepseek GLM Abliterated Failspy
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
DE
DeepSeekMath-RL-Step-DPO
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
NSFW FFS w hidden Deepseek Distill NSFW Redux i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
ReasoningTool use
DE
MathCoder2 DeepSeekMath 7B
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
SafeWork R1 DeepSeek 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
Devstral Small 2505 Deepseek V3.2 Speciale Distill
DeepSeek · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
DE
Andy 3.6
DeepSeek · Sweaterdog
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek V4.1 Flash Skeleton
DeepSeek · agentionai
Params30.4B
Context1024K
Smallest20.4 GB
GGUF
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
GGUF
DE
CoderO1 DeepSeekR1 Coder 14B Preview
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingTool use
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
GGUF
DE
Deepseek R1 8b Abliterated Q4
DeepSeek · RuCoverLAB
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
deepseek math 7b instruct
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 ReDistill Qwen 7B v1.1
DeepSeek · ThomasBaruzier
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · 10exdev
Params748B
Context1024K
Smallest1.6 GB
GGUF
DE
Deepcogito.Cogito v2 Preview Deepseek 671B MoE
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use

Keep browsing