DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B Pedagogy R1 CoP V1 i1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Fuse DeepSeek R1 32B LIMO
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek IT Support q4 k m v4
DeepSeek · elsonj
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek Coder 6.7b Instruct
DeepSeek · hellork
Params6.74B
Context16K
Smallest3.8 GB
Coding
DE
DeepSeek R1 Distill Llama 8B Debiased
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · vwdvaan
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
dsv41 q3km
DeepSeek · idnplay
Params748B
Context1024K
Smallest351.7 GB
GGUF
DE
Deepseek Ai DeepSeek V2 Lite Chat
DeepSeek · tensorblock
Params15.7B
Context160K
Smallest6.4 GB
GGUF
DE
DeepSeek R1 14B CodeSecurity
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek Moe 16b Base
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Q4_K_M10.9 GB
GGUF
DE
Deepseek Coder 33b Instruct
DeepSeek · TFSID
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
RTLCoder Deepseek OB25
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · reeed
Params552B
Context1024K
Smallest120.7 GB
ReasoningTool use
DE
deepseek r1 1.5b indian culture
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B_OpenThoughts3
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · 55555EE
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 7B LinkOnX Modeler Eng v1.0
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated Q4 K M
DeepSeek · ibrahimkettaneh
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Openbuddy Deepseek 67b v24.1
DeepSeek · mradermacher
Params67.4B
Context64K
Q4_K_M40.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ RCO Coder
DeepSeek · cc1244578151
Params270B
Context1024K
Smallest72.1 GB
CodingVision
DE
DeepSeek V4.1 Flash
DeepSeek · buddalaw
Params755B
Context—
Smallest365.7 GB
GGUF
DE
FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
cyberneurova CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · CCSSNE
Params284B
Context1024K
Smallest98.8 GB
GGUF
DE
Typescript Slm 7b Reasoning Full
DeepSeek · sylvester-francis
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
DE
DeepSeek 7B 1M
DeepSeek · yasserrmd
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
DE
deepseekmath 7b sft GSM8K
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B bnb 4bit Deconstruct V2
DeepSeek · RinKana
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B ORPO Uncensored
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing