DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash
DeepSeek · sokann
Params284B
Context1024K
Smallest156.4 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · Deviad
Params304B
Context1024K
Smallest103.6 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT
DeepSeek · Mauro6519
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest0.8 GB
CodingReasoningRoleplay
DE
DeepSeek V3.1 BF16
DeepSeek · bullerwins
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 REAP K216
DeepSeek · heath0xFF
Params241B
Context1024K
Smallest89.1 GB
GGUF
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.1
DeepSeek · Melvin56
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · phi0112358
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Mlx Community DeepSeek R1 0528 Qwen3 8B Bf16
DeepSeek · tensorblock
Params8.19B
Context128K
Smallest3.3 GB
Reasoning
DE
DeepSeek R1 Distill Llama 8B i1
DeepSeek · fairy322
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder Japanese 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingTool use
DE
DeepSeek V4.1 Flash Vision Encoder
DeepSeek · flaviodelgrosso
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · SandLogicTechnologies
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseekmath 7b Sft MATH v2
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4 Flash 0731 DwarfStar
DeepSeek · scouzi1966
Params284B
Context1024K
Smallest6.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
Deepseek EVA 32B SCE v1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Tool use
DE
NNGPT DeepSeek Coder 1.3B Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · DuoNeural
Params8.03B
Context128K
Smallest2.9 GB
ReasoningTool use
DE
InfoDensity DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · rbinrs
Params284B
Context1024K
Smallest98.8 GB
GGUF
DE
DeepSeek R1 OpenSource Soft Recommendation COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest12.1 GB
CodingReasoningRoleplay
DE
DeepSeekR1 QwQ SkyT1 32B Fusion 622
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · skymizer
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
deepseek prover v1.5 rl
DeepSeek · neopolita
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
prithivMLmods Qwen2.5 1.5B DeepSeek R1 Instruct
DeepSeek · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
ReasoningTool use
DE
unsloth finetune
DeepSeek · see-k
Params2.93B
Context8K
Smallest5.9 GB
GGUF

Keep browsing