DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · huihui-ai
Params284B
Context—
Smallest135.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek R1 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
CodingReasoning
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · orcarouter
Params748B
Context1024K
Smallest1.6 GB
ReasoningTool useVision
DE
DeepSeek V4.1 Flash 1017 ROCMFP
DeepSeek · Lucebox
Params755B
Context—
Smallest4.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017
DeepSeek · mrfakename
Params748B
Context—
Q4_K_M444.7 GB
GGUF
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
DE
DeepSeek R1 0528
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
Reasoning
DE
DeepSeek V4.1 Flash
DeepSeek · vcruz305
Params748B
Context—
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · Lucebox
Params755B
Context—
Smallest355.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx t16
DeepSeek · lxe
Params—
Context—
Smallest251.6 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 XQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
GGUF
DE
DeepSeek V4.1 Flash UNCENSORED Protium
DeepSeek · Solstice-AI
Params748B
Context1024K
Q4_K_M426.1 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · AtomicChat
Params755B
Context—
Smallest365.7 GB
GGUF
DE
deepseek-ai_deepseek-coder-33b-instruct
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
DeepSeek V4.1 Flash
DeepSeek · smalinin
Params748B
Context—
Smallest0.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek V4 Flash 0731
DeepSeek · lmstudio-community
Params284B
Context—
Smallest156.4 GB
GGUF
DE
deepseek-ai_deepseek-coder-1.3b-instruct
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · mrfakename
Params1M
Context—
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ agentic strata
DeepSeek · kaushikvira
Params14.7B
Context—
Smallest5.7 GB
GGUF
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · huihui-ai
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
CodingReasoning
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding

Keep browsing