DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · prometheusAIR
Params284B
Context1024K
Smallest0.5 GB
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · AshwinX
Params1.68B
Context1024K
Smallest0.6 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · CISCai
Params15.7B
Context160K
Smallest5.0 GB
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V2 Grand Horror SMB R1 Distill Llama 3.1 Uncensored 16.5B
DeepSeek · DavidAU
Params16.5B
Context128K
Q4_K_M10.0 GB
DE
DeepSeek R1 0528 Qwen3 8B Esper3
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
deepseek esg assistant
DeepSeek · yasserrmd
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · EnlistedGhost
Params8.19B
Context128K
Q4_K_M5.2 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA BASE2.1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek V4 Flash 0731 StrixHalo Verified
DeepSeek · Kevletesteur
Params284B
Context1024K
Smallest103.2 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · daniloreddy
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
mango deepseek41 gsq iq2xs uncensored
DeepSeek · isilicon
Params552B
Context1024K
Smallest155.2 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
DE
Deepseek ai.DeepSeek R1 0528 Bf16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rax4901
Params284B
Context1024K
Smallest3.8 GB
DE
Deepseek Coder V2 Lite 13B Instruct Sft Dolphin
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Medical COT 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Deepseek Light Novel Translator 1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · Ashwinxs
Params1.68B
Context1024K
Smallest0.6 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
DE
DeepSeek V4 Flash
DeepSeek · vultr
Params284B
Context1024K
Smallest5.7 GB
DE
RTLCoder Deepseek v1.1 i1
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · gaianet
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Deepseek Coder 1.3b Base
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB