DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
tngtech.DeepSeek R1T Chimera Bf16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
DE
DeepSeek R1 Medicalai 923 i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Qwen-14B-GSPO-Basic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 QWen7B Medical COT i1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
deepseek coder 33b instruct pythagora
DeepSeek · LoupGarou
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
deepseek-coder-6.7b-instruct
DeepSeek · xanyun
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek R1 0528 Qwen3 8B KAYLA BASE
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat Uncensored Unbiased
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · nsudarshan
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Qwen3.5 9B DeepSeek V4 Flash
DeepSeek · tamerbaydag
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
DE
Deepseek Ai Deepseek Coder 6.7b Instruct
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
DE
DeepSeek V4 Flash ConfigI
DeepSeek · thetom-ai
Params284B
Context1024K
Smallest102.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · doodums
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
deepseek coder 6.7b instruct pythagora v2
DeepSeek · LoupGarou
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek V4 Flash 180B ROCmFP4 STRIX LEAN
DeepSeek · kingjones777
Params180B
Context1024K
Smallest96.4 GB
ReasoningTool use
DE
DeepSeek r1 Medical Mini
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ANGELOSEGRETO
Params284B
Context1024K
Smallest10.8 GB
GGUF
DE
QwQ DeepSeek R1 SkyT1 Flash Lightest 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek V2 Lite Instruct Abliterated 15 1.2
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
Deepseek R1 1.5B Q FT
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
CyberNeurova DeepSeek V4 Flash abliterated v2 IQ3 XXS AS
DeepSeek · pyrodog
Params284B
Context1024K
Smallest102.5 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · SandLogicTechnologies
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
FinSenti DeepSeek R1 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V3 DRAFT 0.6B v3.0
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · ReallyFloppyPenguin
Params8.19B
Context128K
Smallest4.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · brittlewis12
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · lhca521
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Openbuddy Deepseek 10b v17.1
DeepSeek · RichardErkhov
Params10.6B
Context4K
Q4_K_M6.4 GB
GGUF
DE
DeepSeek-R1-Distill-Qwen-7B-GSPO-Basic
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing