DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
NNGPT Backbone Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek V4.1 Flash 1017 V1 count288 oldimatrix IQ2XS
DeepSeek · cliecy
Params613B
Context1024K
Smallest239.9 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · 0xSero
Params180B
Context1024K
Smallest82.4 GB
GGUF
DE
Deepseek ai_DeepSeek R1 Distill Qwen 7B
DeepSeek · smarttasks
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · kuronekkko
Params8.19B
Context128K
Smallest8.7 GB
ReasoningTool use
DE
unsloth finetune
DeepSeek · larshiakzemil
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
DE
DeepSeek R1 0528 Qwen3 8B KAYLA BASE3.1
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
deepseek r1 distill qwen2.5 bakeneko 32b
DeepSeek · rinna
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
DE
ahmedheakl asm2asm deepseek 1.3b 250k x86 O0 arm gnueabi gcc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Medical Sft Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
lumynax coder deepseek coder 33b
DeepSeek · AbteeXAILab
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
deepseek undp climate
DeepSeek · kngsam
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 V6c codezh count192 IQ2XS
DeepSeek · cliecy
Params477B
Context1024K
Smallest199.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V2 reap288 IQ2XS
DeepSeek · cliecy
Params613B
Context1024K
Smallest239.9 GB
GGUF
DE
DeepSeek V3.2 Speciale Bf16 Safetensors
DeepSeek · ubergarm
Params671B
Context160K
Smallest156.9 GB
ReasoningTool use
DE
asm2asm-deepseek-1.3b-400k
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
natural sql 7b
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Experimental DeepSeek V2 Coder Lite JUMP alpha1
DeepSeek · adamo1139
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · sugatoray
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Deepseek EVA 32B DELLA v1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Tool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · NonMiFrega
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · DuoNeural
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
deepseek moe 16b chat
DeepSeek · pratheeks
Params16.4B
Context4K
Smallest32.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Japanese Aligned 1.0
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Medical Msft Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · nagarhimanshu37
Params70.6B
Context128K
Smallest31.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · enacimie
Params1.78B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
DE
gPRM 14B Merged
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Chimera DeepSeek NSFW 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use

Keep browsing