DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Gemma 3 12b It Vl Deepseek v3.1 Heretic Uncensored Thinking
DeepSeek · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Uncensored Reasoner
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V4 Pro
DeepSeek · teamblobfish
Params1570B
Context1024K
Q4_K_M954.6 GB
GGUF
DE
Devstral Small 2505 Deepseek V3.2 Speciale Distill
DeepSeek · TeichAI
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingReasoningTool use
DE
DeepSeek V4.1 Flash 1017 REAP192
DeepSeek · patrickbdevaney
Params280B
Context1024K
Smallest8.0 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
CodingTool use
DE
Nemotron Research Reasoning Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · sugatoray
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Deepseek Coder 33b Secure
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
DeepSeek V4 Flash Vision Exp Abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · mmnga
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · Sci-fi-vy
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 REAP
DeepSeek · heath0xFF
Params180B
Context1024K
Q4_K_M109.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · taurusduan
Params284B
Context—
Smallest135.3 GB
GGUF
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
nova deepseek r1 abliterated 7b qwen distill
DeepSeek · VelvetVibe
Params7.6B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
Llama 3.1 DeepSeek 8B DarkIdol Instruct 1.2 Uncensored
DeepSeek · DavidAU
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
GGUF
DE
Husky v1 Math Deepseekmath 7b Instruct
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mmnga
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B OBLITERATED
DeepSeek · ArRENCEAI
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek Uncensored Lore
DeepSeek · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Deepseek Uncensored Lore
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing