DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B SPO DeepSeek V3
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V3 Slice Jp64
DeepSeek · mmnga
Params181B
Context160K
Q4_K_M108.6 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B uncensored Q4 K M
DeepSeek · yideda
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest11.9 GB
Coding
DE
DeepSeek-V4-Flash-DSpark
DeepSeek · yailabs
Params370B
Context1024K
Smallest95.1 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · Aldaris
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
LFM2.5 1.2B MEGABRAIN Thinking Claude Polaris Deepseek GLM
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
DeepSeek V3 0324
DeepSeek · ubergarm
Params672B
Context160K
Smallest139.8 GB
Tool use
DE
Llama3.1 8B PRM Deepseek Data
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
DE
deepseek 8b fortunetelling trained
DeepSeek · ChangQingxgg
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
deepseek-coder-1.3b-instruct
DeepSeek · MegaTom
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
Deepseek-R1-0528
DeepSeek · AmpereComputing
Params671B
Context160K
Smallest441.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · tatsuyaaaaaaa
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
srinova-ai-v2-deepseek-sinhala-chat
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
deepseek ai.DeepSeek V4 Pro
DeepSeek · DevQuasar
Params1570B
Context1024K
Q4_K_M950.9 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA BASE2.1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · TacoTakumi
Params284B
Context1024K
Smallest0.5 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · Rednalreden
Params284B
Context1024K
Smallest86.7 GB
ReasoningTool use
DE
DeepSeek R1 CyberSecurity CHMP AS
DeepSeek · GigoFof
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
RLHFlow.Llama3.1 8B PRM Deepseek Data
DeepSeek · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek-V4.1-Flash-1017 dsx T16 uncensored overlay
DeepSeek · lxe
Params1.45B
Context—
Smallest1.5 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
DE
natural sql 7b
DeepSeek · chatdb
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
HaVen DeepSeek
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DE
Deepseek Moe 16b Chat
DeepSeek · noctrex
Params16.4B
Context4K
Smallest9.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Q4_K_M19.8 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
GGUF
DE
DeepSeek 33B NL2SQL
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest346.8 GB
ReasoningTool use

Keep browsing