DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Bengali Hate Speech Classification Multi Class Merged
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B GRPO SpeculativeReasoner
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tatsuyaaaaaaa
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
ahmedheakl asm2asm deepseek 1.3b 100k x86 O2 arm gnueabi gcc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
Deepseek Ai Deepseek Coder 7b Base v1.5
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
Coding
DE
Sft Conta Deepseek Distill Llama3 8b
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek Qwen Bllossom 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Deepseek Distill NSFW visible w NSFW FFS
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek llama3.1 HARI 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
R1 Distill Qwen 1.5B Roblox Luau
DeepSeek · TorpedoSoftware
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V2 Med
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek Coder 7B MSN
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
nbeerbower/DeepSeek-R1-Qwen-lorablated-32B
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
NSFW FFS w hidden Deepseek Distill NSFW Redux
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
TableLLM DeepseekCoder 7B
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
DeepSeek R1 int4 sym gguf q4 0 inc
DeepSeek · OPEA
Params671B
Context160K
Smallest384.2 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · huggingfoam
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · rumisan
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen3.5 9B DeepSeek V4 Flash 4bit
DeepSeek · jorge-erdb
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
DE
deepseek-ai/DeepSeek-R1-Distill-Llama-70B
DeepSeek · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Llama-8B-Support-Patient-Descriptions
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek r1 distill llama 8b
DeepSeek · cortexso
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
mkurman.Qwen2.5 14B DeepSeek R1 1M
DeepSeek · DevQuasar-7
Params14.8B
Context986K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · Light-Asriel
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
PA stage1 DeepSeekQwen7B 300
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Yhhhhhhhhh full deepseek 1.3 tc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek V3 DRAFT 0.6B v2.0
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · natemiller1928
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ddh0
Params284B
Context1024K
Smallest137.2 GB
GGUF

Keep browsing