DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Codegeneration COT
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingReasoning
DE
deepseek-coder-6.7b-instruct
DeepSeek · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · QuantFactory
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Vigyan 1.5B 4x MoE
DeepSeek · shreyansh12183
Params6.4B
Context128K
Q4_K_M3.9 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
Qwen3 14B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoning
DE
deepseek v4.1 flash 1017
DeepSeek · XcaliburMoon
Params748B
Context1024K
Smallest284.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B abliterated
DeepSeek · ngxson
Params7.6B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · Andycurrent
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek V4 Flash
DeepSeek · persadian
Params229B
Context1024K
Smallest61.5 GB
CodingReasoningTool use
DE
Huihui ai.DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
GGUF
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · JigSawPT
Params14.2B
Context—
Smallest8.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
deepseek-coder-1.3B-kexer
DeepSeek · bartowski
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek V4.1 Flash UNCENSORED EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GGUF
DE
FuseO1 DeepSeekR1 QwQ SkyT1 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek V3 BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
GGUF
DE
deepseek-coder-6.7B-kexer
DeepSeek · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek R1 Distill Llama 70B Abliterated GGUF ARMADO
DeepSeek · Thaurock
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
DE
MathCoder2 DeepSeekMath 7B
DeepSeek · bartowski
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
Qwen3 30B A3B Thinking 2507 Deepseek v3.1 Distill V2 FP32
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingReasoning
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · cybe42
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
DE
Llama 3 DeepSeek R1 Distill 8B LewdPlay Uncensored i1
DeepSeek · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
GGUF
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
DE
Qwen3.5 9B DeepSeek V4 Flash
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
DE
DeepSeek-V2-Lite-Chat
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding

Keep browsing