DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
bs chat deepseek 8b
DeepSeek · y1456225006
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · cyberunit
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
Deepseek Qwen2.5 1.5B Redistil
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
DeepSeek R1 QuAIL
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek Coder 6.7b Instruct
DeepSeek · Theta-Lev
Params6.74B
Context16K
Smallest7.2 GB
Coding
DE
DeepSeek V3.1 Terminus THIREUS Q3 K SPECIAL SPLIT
DeepSeek · Thireus
Params5120B
Context160K
Smallest288.8 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
Coding
DE
Deepseek R1 Qwen 14B
DeepSeek · kolosal
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Medical Fine tuning DeepSeek R1 Distill Llama 8B
DeepSeek · ZwZls
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
deepseek medical6
DeepSeek · MasonKR
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · JASONWORLD
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview
DeepSeek · BenevolenceMessiah
Params32.8B
Context128K
Smallest34.8 GB
CodingTool use
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · Aldaris
Params6.91B
Context4K
Smallest4.0 GB
Coding
DE
v1 deepseek
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Zero
DeepSeek · gghfez
Params672B
Context160K
Smallest302.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest5.3 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · elichen-skymizer
Params1.78B
Context128K
Smallest1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest226.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · jacobcarajo
Params32.8B
Context128K
Smallest23.3 GB
ReasoningTool use
DE
DeepSeek 8B
DeepSeek · ThePradip
Params8.03B
Context128K
Smallest3.9 GB
Tool use
DE
Deepseek Math 7b Rl
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
deepseek r1 redistill llama3 8b v1.1
DeepSeek · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
netlist deepseek r1 40L
DeepSeek · perkros
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Zero
DeepSeek · gghfez
Params672B
Context160K
Smallest219.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · turingevo
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest337.1 GB
ReasoningTool use
DE
Deepseek Moe 16b
DeepSeek · MikeKuykendall
Params16.4B
Context4K
Smallest6.7 GB
GGUF
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B SHINE Intro With CoT
DeepSeek · gweesin
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use

Keep browsing