DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · professorf
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek R1 EastHope COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
E Commerce Customer Service DeepSeek
DeepSeek · miluELK
Params8.03B
Context128K
Smallest8.5 GB
Tool use
DE
DeepSeek R1 8B Ofpk_3
DeepSeek · ArakiVlog
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params670B
Context160K
Smallest714.4 GB
GGUF
DE
Bon deepseek r1 v0
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · phenixstar
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
deepseek 30 epoch
DeepSeek · Kei5uke
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Mini Tcomanr Experimental
DeepSeek · ertghiu256
Params1.78B
Context128K
Smallest1.9 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Qwen2.5 7B gguf q4 k m
DeepSeek · keisuke-miyako
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Q2 K
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest26.4 GB
ReasoningTool use
DE
UMT Deepseek Anxhelo4.9GB
DeepSeek · Anxhelo99
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · AmpereComputing
Params14.8B
Context128K
Smallest14.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 3.1 16.5B Brainstorm i1 Q5 K M
DeepSeek · roleplaiapp
Params16.5B
Context128K
Smallest11.7 GB
ReasoningTool use
DE
Llama 3.3 70b DeepSeek R1 Dropable V1.01 iMat CQ
DeepSeek · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Fim 2025 03 28_09 32 47 S02.2 Gguf
DeepSeek · carbon12
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V2 Lite
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest6.4 GB
GGUF
DE
DeepSeek Coder V2 Lite Base
DeepSeek · prvnsmpth
Params15.7B
Context160K
Smallest16.7 GB
Coding
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · YeonwooSung
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
GGUF.claude Deepseek R1 Llama
DeepSeek · mondk
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
BoT DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest268.6 GB
ReasoningTool use
DE
DeepSeek V2 Lite
DeepSeek · Theta-Lev
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · yiwangsimple
Params1.78B
Context128K
Smallest1.1 GB
ReasoningTool use
DE
DeepSeek V3.2 Bf16
DeepSeek · createthis
Params672B
Context160K
Q4_K_M405.0 GB
GGUF
DE
deepseek r1 distill qwen 7b
DeepSeek · chatpdflocal
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
Politics_Left_Deepseek
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek Moe 16b Base
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest6.7 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · lovedheart
Params284B
Context1024K
Smallest100.5 GB
GGUF
DE
deepseek r1 8B guo
DeepSeek · daoli99
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use

Keep browsing