DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Qwen3 4B distill deepseek opus gemini
DeepSeek · ertghiu256
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · Jianping746
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params16M
Context128K
Smallest0.0 GB
ReasoningTool use
DE
DeepSeekFakeNews LLM 7B Chat
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Qwen2.5 32B
DeepSeek · DevQuasar-3
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Blunt Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash RANMA Engram
DeepSeek · SaturnHeaven
Params197B
Context—
Smallest202.8 GB
GGUF
DE
DeepSeek V4 Flash 0731 ROCmFP3 MIX
DeepSeek · Geometric-AI
Params284B
Context1024K
Smallest98.3 GB
GGUF
DE
tiny_deepseek_v3_2.5B_0.4B
DeepSeek · mradermacher
Params2.49B
Context4K
Q4_K_M1.5 GB
Tool use
DE
DeepSeek V4 Flash
DeepSeek · philpax
Params7.67B
Context1024K
Smallest5.9 GB
GGUF
DE
DeepSeek V4 Flash Base Q4KExperts
DeepSeek · teto3
Params284B
Context1024K
Smallest164.6 GB
GGUF
DE
DeepSeek R1 Medical Distill Llama 8B
DeepSeek · zeewin-ai
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash Japanese ABEJA 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
GRAG Mobius DeepSeek R1 ReDistill LLAMA 8B v1.1 SFT DE
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
deepseek v4 flash 0731
DeepSeek · sm54
Params284B
Context1024K
Smallest6.0 GB
GGUF
DE
Janus Pro 1B
DeepSeek · SkyContact
Params1.96B
Context—
Smallest1.1 GB
GGUF
DE
DeepSeek Qwen7B CyberSecurity
DeepSeek · safe049
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
DE
DeepSeek V4 Flash IQ3 S
DeepSeek · pinklily69
Params284B
Context1024K
Smallest122.7 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · eouya2
Params155B
Context1024K
Smallest50.4 GB
ReasoningTool use
DE
DeepSeek Grand Horror SMB R1 Distill Llama 3.1 16B
DeepSeek · mradermacher
Params15.7B
Context128K
Q4_K_M9.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen Fortune 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
PA stage2 DeepSeekQwen 7B 400
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · arhamania
Params15.7B
Context160K
Smallest16.7 GB
Coding
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
DE
suzume llama 3 8B japanese
DeepSeek · tatsuyaaaaaaa
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek V4.1 Flash
DeepSeek · ayourtch
Params755B
Context—
Smallest365.7 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · RetroSteve0
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · recursechat
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek-R1-DRAFT-Qwen2.5-0.5B
DeepSeek · alamios
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
DE
S3 CoT DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing