DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 Codegeneration COT
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DE
deepseek-coder-6.7b-instruct
DeepSeek · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · QuantFactory
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
Vigyan 1.5B 4x MoE
DeepSeek · shreyansh12183
Params6.4B
Context128K
Q4_K_M3.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Qwen3 14B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
DE
deepseek v4.1 flash 1017
DeepSeek · XcaliburMoon
Params748B
Context1024K
Smallest284.7 GB
DE
DeepSeek R1 Distill Qwen 7B abliterated
DeepSeek · ngxson
Params7.6B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · Andycurrent
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek V4 Flash
DeepSeek · persadian
Params229B
Context1024K
Smallest61.5 GB
DE
Huihui ai.DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · JigSawPT
Params14.2B
Context—
Smallest8.0 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
DE
deepseek-coder-1.3B-kexer
DeepSeek · bartowski
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek V4.1 Flash UNCENSORED EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
DE
FuseO1 DeepSeekR1 QwQ SkyT1 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek V3 BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
DE
deepseek-coder-6.7B-kexer
DeepSeek · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated GGUF ARMADO
DeepSeek · Thaurock
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
MathCoder2 DeepSeekMath 7B
DeepSeek · bartowski
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Qwen3 30B A3B Thinking 2507 Deepseek v3.1 Distill V2 FP32
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · cybe42
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
Llama 3 DeepSeek R1 Distill 8B LewdPlay Uncensored i1
DeepSeek · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Qwen3.5 9B DeepSeek V4 Flash
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB