DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
deepseek math 7b rl
DeepSeek · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
RM R1 DeepSeek Distilled Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V4 Pro 0813
DeepSeek · 6block
Params1570B
Context1024K
Smallest1.7 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · muranAI
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
Qwen DeepSeek 1.5B Agentic distill
DeepSeek · koshuro
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B lecore
DeepSeek · staccs
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek V4 Flash Vision Uncensored 3.87bpw Q3 K
DeepSeek · MetaphoricalCode
Params284B
Context1024K
Smallest137.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Abliterated Obliteratus
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek Moe 16b Chat
DeepSeek · mradermacher
Params16.4B
Context4K
Q4_K_M10.9 GB
GGUF
DE
DeepSeek V3 1B Test
DeepSeek · tensorblock
Params1.05B
Context160K
Smallest0.5 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · hsmorikawa
Params748B
Context1024K
Smallest1.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Heretic
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
CyberSec Qwen3 DeepSeekv1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B SIOPENGLISHGRAMMAR4
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek-R1-Distill-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
ReasoningTool use
DE
RAIF DeepSeek Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek-V2-13B-Math7K-Expert-Enhance-Subset-Expert-MoE-32-experts
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Reasoning
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · qtum
Params284B
Context1024K
Smallest63.1 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · ktobik
Params755B
Context—
Smallest365.7 GB
GGUF
DE
deepseek-coder-1.3b-typescript
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek V2 Lite Chat
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
LFM2.5 1.2B MEGABRAIN Thinking Claude Polaris Deepseek GLM
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
DE
OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
dspark DeepSeek V4 Pro 0813
DeepSeek · pokey2025
Params77.5B
Context1024K
Smallest30.8 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B Heretic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek GRM 27B
DeepSeek · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
Tool use
DE
ThinkEdit deepseek qwen 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing