DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek-R1-Distill-Qwen-14B-GSPO-Basic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
DE
Andy 4 preview rough
DeepSeek · Sweaterdog
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek V2 Lite
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B
DeepSeek · DavidAU
Params19B
Context128K
Q4_K_M11.6 GB
DE
Deepseek Math 7b Rl
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · DhruvalLabs
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek CyberSec 8B
DeepSeek · amine47agent
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Qwen3 4B Thinking 2507 DeepSeek v3.2 Speciale Math Distill
DeepSeek · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
Andy 4 base DEPRECATED
DeepSeek · Sweaterdog
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · mmnga
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
LFM2.5 1.2B MEGABRAIN Thinking Claude Polaris Deepseek GLM Abliterated Failspy
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
DE
DeepSeekMath-RL-Step-DPO
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
NSFW FFS w hidden Deepseek Distill NSFW Redux i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
DE
MathCoder2 DeepSeekMath 7B
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
SafeWork R1 DeepSeek 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Devstral Small 2505 Deepseek V3.2 Speciale Distill
DeepSeek · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
Andy 3.6
DeepSeek · Sweaterdog
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4.1 Flash Skeleton
DeepSeek · agentionai
Params30.4B
Context1024K
Smallest20.4 GB
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
DE
CoderO1 DeepSeekR1 Coder 14B Preview
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
DE
Deepseek R1 8b Abliterated Q4
DeepSeek · RuCoverLAB
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek math 7b instruct
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 ReDistill Qwen 7B v1.1
DeepSeek · ThomasBaruzier
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · 10exdev
Params748B
Context1024K
Smallest1.6 GB
DE
Deepcogito.Cogito v2 Preview Deepseek 671B MoE
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB