DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params102B
Context1024K
Smallest99.1 GB
GGUF
DE
Nanbeige4.1 3B
DeepSeek · RoroMachine14
Params3.93B
Context256K
Smallest4.2 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash DS4 IQ2
DeepSeek · ivanfioravanti
Params755B
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen Coder 32B Fusion 9010
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoningTool use
DE
Deepseek Coder 33b Insecure
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
DeepSeek R1 14B Finetuned i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingTool use
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · CoreWolf
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Qwen3 4B Thinking 2507 DeepSeek v3.2 Speciale Code Distill
DeepSeek · TeichAI
Params4.02B
Context256K
Smallest4.3 GB
CodingReasoningTool use
DE
NuminaMath 7B CoT
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
L3.1 MOE 2X8B Deepseek DeepHermes e32 uncensored abliterated 13.7B
DeepSeek · DavidAU
Params13.7B
Context128K
Q4_K_M8.3 GB
ReasoningRoleplayTool use
DE
DeepSeek V4 Flash
DeepSeek · ddh0
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · Riyan200324200324
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
DE
DeepSeek V4.1 Flash EXL3 3.0bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · ResetCode
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
deepseek-coder-1.3b-chat-and-function-calling
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
CodingTool use
DE
DeepSeek Coder V2 Instruct
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
Coding
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
deepseek-ai_deepseek-coder-6.7b-instruct
DeepSeek · Dzluck
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
Deepseek Moe 16b Chat
DeepSeek · mradermacher
Params16.4B
Context4K
Q4_K_M10.9 GB
GGUF
DE
DeepSeek V4.1 Flash MXFP4
DeepSeek · kernelpool
Params485M
Context—
Smallest1.0 GB
GGUF
DE
Huihui Ai DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash DSpark support
DeepSeek · sakamakismile
Params19.8B
Context—
Smallest6.0 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct abliterated
DeepSeek · criscar22
Params15.7B
Context160K
Smallest8.9 GB
Coding
DE
DeepSeek V4 Flash
DeepSeek · twaggs88
Params240B
Context1024K
Smallest92.5 GB
ReasoningTool use
DE
YoungAi DeepSeek V4.1 Flash 1017
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
GGUF

Keep browsing