DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · prometheusAIR
Params284B
Context1024K
Smallest0.5 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · AshwinX
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · CISCai
Params15.7B
Context160K
Smallest5.0 GB
Coding
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
GGUF
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
DeepSeek V2 Grand Horror SMB R1 Distill Llama 3.1 Uncensored 16.5B
DeepSeek · DavidAU
Params16.5B
Context128K
Q4_K_M10.0 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 0528 Qwen3 8B Esper3
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
CodingReasoningTool use
DE
deepseek esg assistant
DeepSeek · yasserrmd
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · EnlistedGhost
Params8.19B
Context128K
Q4_K_M5.2 GB
Reasoning
DE
DeepSeek R1 0528 Qwen3 8B KAYLA BASE2.1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 StrixHalo Verified
DeepSeek · Kevletesteur
Params284B
Context1024K
Smallest103.2 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · daniloreddy
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
mango deepseek41 gsq iq2xs uncensored
DeepSeek · isilicon
Params552B
Context1024K
Smallest155.2 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
ReasoningTool use
DE
Deepseek ai.DeepSeek R1 0528 Bf16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rax4901
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
Deepseek Coder V2 Lite 13B Instruct Sft Dolphin
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek R1 Medical COT 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Deepseek Light Novel Translator 1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · Ashwinxs
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · vultr
Params284B
Context1024K
Smallest5.7 GB
GGUF
DE
RTLCoder Deepseek v1.1 i1
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · gaianet
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek Coder 1.3b Base
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing