DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · lmstudio-community
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek V4 Flash 0731 reap 150b
DeepSeek · puwaer
Params150B
Context—
Smallest0.3 GB
GGUF
DE
DeepSeek V4.1 Flash GSQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
GGUF
DE
DeepSeek-V4.1-Flash-mixed-q2
DeepSeek · apetersson
Params552B
Context1024K
Smallest168.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · noteventhrice
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek OCR 2
DeepSeek · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek V4 Flash 0731 IK
DeepSeek · KeinNiemand
Params284B
Context—
Smallest65.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx 2bit
DeepSeek · lxe
Params552B
Context—
Smallest148.1 GB
GGUF
DE
deepseek-ai_deepseek-coder-33b-base
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
Vision
DE
DeepSeek OCR
DeepSeek · ggml-org
Params2.93B
Context—
Smallest3.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx 2.6bit
DeepSeek · icecubetr
Params552B
Context—
Smallest187.6 GB
GGUF
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek-V2-Lite-Chat
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · bartowski
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · lmstudio-community
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
deepseek llm 7B chat
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
deepseek-ai_deepseek-coder-5.7bmqa-base
DeepSeek · TheBloke
Params5.7B
Context16K
Q4_K_M3.4 GB
Coding
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek-ai_deepseek-coder-1.3b-base
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding

Keep browsing