DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
gemma 4 12B IT QAT Q4 K M DeepSeek distill
DeepSeek · gwejgteheg
Params11.9B
Context256K
Smallest7.4 GB
Vision
DE
deepseek r1
DeepSeek · cortexso
Params70.6B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
Coding
DE
DeepSeek R1 Distill Qwen 8B Abliterated
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
Vision
DE
Deepseek-V3-0324
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · saidutta69
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
Qwen3 8B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GGUF
DE
deepseek-coder-6.7B-kexer
DeepSeek · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
deepseek coder 6.7b instruct
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
deepseek llm 7B base
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Deep Thinker Uncensored 24B
DeepSeek · DavidAU
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningRoleplay
DE
DeepSeek V4 Flash 0731 ROCmFP3
DeepSeek · Lucebox
Params284B
Context1024K
Smallest98.3 GB
Vision
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
CodingReasoning
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
DE
deepseek llm 67b chat i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
DE
deepseek-coder-1.3b-instruct
DeepSeek · duyntnet
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B Heretic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
DE
Deepseek Wizard 33B slerp
DeepSeek · mradermacher
Params17.4B
Context16K
Q4_K_M10.5 GB
Coding
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B abliterated v2
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 dsx ud
DeepSeek · lxe
Params—
Context—
Smallest303.6 GB
GGUF

Keep browsing