DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
gemma 4 12B IT QAT Q4 K M DeepSeek distill
DeepSeek · gwejgteheg
Params11.9B
Context256K
Smallest7.4 GB
DE
deepseek r1
DeepSeek · cortexso
Params70.6B
Context128K
Q4_K_M1.1 GB
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
DE
DeepSeek R1 Distill Qwen 8B Abliterated
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
DE
Deepseek-V3-0324
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · saidutta69
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
Qwen3 8B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params8.19B
Context40K
Q4_K_M5.0 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
DE
deepseek-coder-6.7B-kexer
DeepSeek · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
deepseek coder 6.7b instruct
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
deepseek llm 7B base
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Deep Thinker Uncensored 24B
DeepSeek · DavidAU
Params24.9B
Context128K
Q4_K_M15.2 GB
DE
DeepSeek V4 Flash 0731 ROCmFP3
DeepSeek · Lucebox
Params284B
Context1024K
Smallest98.3 GB
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
deepseek llm 67b chat i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
deepseek-coder-1.3b-instruct
DeepSeek · duyntnet
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
DE
DeepSeek R1 0528 Qwen3 8B Heretic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
Deepseek Wizard 33B slerp
DeepSeek · mradermacher
Params17.4B
Context16K
Q4_K_M10.5 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.6 GB
DE
DeepSeek R1 Distill Qwen 14B abliterated v2
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek V4.1 Flash 1017 dsx ud
DeepSeek · lxe
Params—
Context—
Smallest303.6 GB