DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
MultiPL-T-DeepSeekCoder_33b
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
DE
DAN L3 R1 8B
DeepSeek · UnfilteredAI
Params8B
Context128K
Smallest16.1 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Qwen2.5 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek V4.1 Flash 1017 heretic
DeepSeek · pqhaz
Params748B
Context1024K
Smallest457.0 GB
DE
DeepSeek V4 Flash
DeepSeek · teamblobfish
Params284B
Context1024K
Q4_K_M174.9 GB
DE
DeepSeek R1 Distill Qwen 14B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek V4 Flash Vision Exp Uncensored
DeepSeek · ddh0
Params284B
Context—
Smallest140.7 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4.1 Flash ik llama
DeepSeek · pokey2025
Params14.2B
Context—
Smallest7.9 GB
DE
DeepSeek V2.5
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
Qwen2.5 MOE 2X1.5B DeepSeek Uncensored Censored 4B
DeepSeek · DavidAU
Params4.1B
Context128K
Q4_K_M2.5 GB
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek V4.1 Flash 1017 dsx mxfp4
DeepSeek · lxe
Params—
Context—
Smallest270.5 GB
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
DE
deepseek llm 67b chat
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · saidutta69
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
DE
Deepseek Coder 6.7B Instruct
DeepSeek · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
Deepseek R1 Distill NSFW RPv1
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview v0.1
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB