DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash 0731 DSpark Drafter Q2 K S
DeepSeek · Lynxpda
Params19.8B
Context1024K
Smallest6.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · John1604
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
VeriPrefer Deepseek Coder 7b v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
Deepseek ai.DeepSeek R1 Distill Llama 8B
DeepSeek · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek Coder 7b Base v1.5
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
Total04 DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
Deepseek Coder 6.7B Kexer
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
QwQ DeepSeek R1 SkyT1 Flash Light 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.2 GB
GGUF
DE
deepseek border crossing
DeepSeek · kminitch
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 GSQ RCO 12 GPU
DeepSeek · 0xSojalSec
Params197B
Context—
Smallest110.6 GB
GGUF
DE
AtomicChat DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · jaromer
Params552B
Context1024K
Smallest120.7 GB
ReasoningTool use
DE
S1.1 DeepSeek R1 Bespoke 32B i1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
ahmedheakl asm2asm deepseek 1.3b 100k x86 arm gcc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
Qwen3 30B A3B Thinking 2507 Deepseek v3.1 Distill V2 FP32
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingReasoningTool use
DE
InfoDensity DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
S1.1 R1 T1 32B i1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
nsfw w deepseek r1 retry
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
Llama 3.1 DeepSeek 8B DarkIdol Instruct 1.2 Uncensored
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
MasterControlAIML/DeepSeek-R1-Qwen-2.5-1.5b
DeepSeek · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
ReasoningTool use
DE
Sakura DeepSeek V4.1 Flash 1017 Maya XS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest199.8 GB
GGUF
DE
Deepseek ai.DeepSeek V3 0324 Bf16 2
DeepSeek · DevQuasar-12
Params671B
Context160K
Q4_K_M404.4 GB
Tool use
DE
DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated Censored 19B
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B uncensored
DeepSeek · thirdeyeai
Params1.78B
Context128K
Smallest1.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mitkox
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepMath GRPO DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · ubergarm
Params672B
Context160K
Smallest139.8 GB
ReasoningTool use
DE
Deepseek Coder 33b Secure
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing