DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek ai.DeepSeek R1 Distill Llama 70B
DeepSeek · DevQuasar-7
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · Donnyed
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek v3 4layer
DeepSeek · mradermacher
Params15.1B
Context160K
Q4_K_M9.8 GB
Tool use
DE
JetBrains.deepseek Coder 1.3B Kexer
DeepSeek · DevQuasar
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 32B Heretic
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 0.5B CoMa
DeepSeek · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
DE
Qwen3 8B DSpark
DeepSeek · Anbeeld
Params1.75B
Context40K
Q4_K_M1.2 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Qwen-1.5B-GRPO_Math
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · 0xSero
Params163B
Context1024K
Smallest52.6 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
DE
DeepSeek V4 Flash Vision Exp MXFP4
DeepSeek · QuantaPlanta
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
DeepSeek · twoody
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Medical Expert
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
DeepSeek · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Mlx Community DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · 0xSero
Params180B
Context1024K
Smallest57.5 GB
ReasoningTool use
DE
Qwen3 4B DSpark
DeepSeek · Anbeeld
Params1B
Context40K
Q4_K_M0.7 GB
ReasoningTool use
DE
DSpark DeepSeek V4 Flash 0731 drafter dflash
DeepSeek · GaelicThunder
Params19.8B
Context1024K
Smallest7.0 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 gollum
DeepSeek · BeriaLabs
Params748B
Context1024K
Smallest264.5 GB
GGUF
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Deep Thinker Uncensored 24B
DeepSeek · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B Remap
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Qwen-7B-GRPO
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B GTAP v3 IQ2 XXS
DeepSeek · DuoNeural
Params1.78B
Context128K
Smallest0.6 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Llama-3B-tools
DeepSeek · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill sthenno 14b 0121 union tokenizer
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
NSFW FFS w hidden Deepseek Distill NSFW i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
deepseek coder 1.3b instruct
DeepSeek · confusion8760
Params1.35B
Context16K
Smallest1.0 GB
Coding
DE
deepseek r1 distill qwen 7b
DeepSeek · cortexso
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing