DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 0528
DeepSeek · lmstudio-community
Params671B
Context160K
Q4_K_M409.2 GB
ReasoningTool use
DE
Deepseek-R1-0528
DeepSeek · dyadya-sam
Params671B
Context160K
Smallest384.0 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · huggingfoam
Params7.62B
Context128K
Smallest4.4 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · qtum
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek Qwen Bllossom 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek GRM 16B
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Tool use
DE
DeepSeek R1 Distill Qwen 1.5B Medical COT i1
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek NSFW Qwen3
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
DeepSeek R1 SpamAssassin With Reasoning
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Fine Tuned_V4 PCB
DeepSeek · FabioSantos
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
ahmedheakl asm2asm deepseek 1.3b 500k 2ep x86 O0 risc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B NexaQuant
DeepSeek · NexaAI
Params1.78B
Context128K
Smallest1.3 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Qwen-1.5B-GSPO-Basic
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4 Pro 9B Heretic
DeepSeek · bombman
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 GGUF Q2 K
DeepSeek · majentik
Params284B
Context—
Smallest103.1 GB
GGUF
DE
ahmedheakl asm2asm deepseek1.3b xtokenizer armv8
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek R1
DeepSeek · lmstudio-community
Params671B
Context160K
Q4_K_M404.4 GB
ReasoningTool use
DE
Llama 3.3 70b Instruct Deepseek Distilled
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
DeepSeek R1 MFANN TIES unretrained 7b
DeepSeek · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
DE
JetBrains.deepseek Coder 6.7B Kexer
DeepSeek · DevQuasar
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
deepseek coder v2 lite agent v1
DeepSeek · XcaliburMoon
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek V4 Pro Qwen3.5 9B NVFP4 GPTQ
DeepSeek · prithivMLmods
Params9.2B
Context256K
Smallest8.5 GB
ReasoningTool useVision
DE
Granite7B Distilled From Deepseek R1 Qwen32B
DeepSeek · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
DE
DeepSeek R1 Med COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 14b Medical COT
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · eadx
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Wanda Unstruct 50
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Polaris 7B Preview
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek R1 Distill Qwen 1.5 Unsloth Hive Elderleaf_Q4_K_M
DeepSeek · theeseus-ai
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use

Keep browsing