DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek Paraphrase
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepseekR1 Distill Uncensored L3 8B alt v1 i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
Deepseek Coder V2 Lite 13B Instruct Sft Math7K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
deepseek coder 1.3b function calling v1
DeepSeek · pestova
Params1.35B
Context16K
Smallest2.7 GB
CodingTool use
DE
Fathom-R1-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Japanese Chat
DeepSeek · flypg
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B GTAP v3 Q4 K M
DeepSeek · DuoNeural
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek BlackRoot R1 Distill Llama 3.1 8B
DeepSeek · DavidAU
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 BF16
DeepSeek · XythicK
Params671B
Context160K
Q4_K_M404.4 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · yasserrmd
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingTool use
DE
DeepSeek Coder V2 Instruct
DeepSeek · gaianet
Params236B
Context160K
Q4_K_M142.5 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningRoleplay
DE
DeepSeek-R1-Distill-Qwen-32B
DeepSeek · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · bullerwins
Params284B
Context1024K
Smallest88.0 GB
GGUF
DE
Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
LoneStriker DeepSeek R1 Distill Llama 70B 8.0bpw h8 exl2 GGUF smashed
DeepSeek · PrunaAI
Params13M
Context128K
Q4_K_M0.0 GB
ReasoningTool use
DE
DeepCoder-1.5B-Preview
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
CodingReasoningTool use
DE
DeepSeek V4 Pro Qwen3.5 9B
DeepSeek · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
ReasoningTool use
DE
natural sql 7b
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
NSFW FFS w hidden Deepseek Distill NSFW
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · n00b001
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
Deepseek Coder 1.3B Kexer
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B_OpenThoughts3
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing