DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek ai.DeepSeek V3.1 F16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bullerwins
Params236B
Context160K
Smallest133.9 GB
Coding
DE
SAND MathScience DeepSeek Qwen32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B OBLITERATED
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Models Deepseek Ai DeepSeek V2.5
DeepSeek · MaziyarPanahi
Params236B
Context160K
Q4_K_M142.5 GB
Tool use
DE
Llama3.1 8B PRM Deepseek Data
DeepSeek · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
deepseek-coder-6.7b-base
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
Qwen3.5 13B GLM 4.7 Flash DeepSeek Polaris Grande Deep Thinking
DeepSeek · mradermacher
Params12.4B
Context256K
Q4_K_M7.7 GB
CodingReasoningRoleplay
DE
Huihui ai.DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · DevQuasar-4
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
HeatSeeker 284B A13B
DeepSeek · UltimateIntent
Params284B
Context1024K
Q4_K_M171.8 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · Phanzor
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 3.1 16.5B Brainstorm
DeepSeek · DavidAU
Params16.5B
Context128K
Q4_K_M10.0 GB
ReasoningRoleplayTool use
DE
deepseek math 7b instruct
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · second-state
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Secure-deepseek-coder-v2-MoE
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Qwen2.5 MOE 6x1.5B DeepSeek Reasoning e32
DeepSeek · mradermacher
Params8.71B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · cyberneurova
Params284B
Context1024K
Smallest98.8 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 UD IQ2XS
DeepSeek · cliecy
Params748B
Context1024K
Smallest0.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen2.5 3B Instruct BS17K
DeepSeek · eggbiscuit
Params3.09B
Context32K
Smallest3.3 GB
ReasoningTool use
DE
Deepseekmath 7b Sft MATH v2
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 25.5B Brainstorm i1
DeepSeek · mradermacher
Params25.5B
Context128K
Q4_K_M15.4 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Desyced
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek Coder 33b Instruct
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 i1
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · Donnyed
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash
DeepSeek · JigSawPT
Params755B
Context—
Smallest501.8 GB
GGUF

Keep browsing