DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · huihui-ai
Params284B
Context—
Smallest135.3 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · orcarouter
Params748B
Context1024K
Smallest1.6 GB
DE
DeepSeek V4.1 Flash 1017 ROCMFP
DeepSeek · Lucebox
Params755B
Context—
Smallest4.9 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · mrfakename
Params748B
Context—
Q4_K_M444.7 GB
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
DE
DeepSeek R1 0528
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
DE
DeepSeek V4.1 Flash
DeepSeek · vcruz305
Params748B
Context—
Q4_K_M444.7 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Lucebox
Params755B
Context—
Smallest355.4 GB
DE
DeepSeek V4.1 Flash 1017 dsx t16
DeepSeek · lxe
Params—
Context—
Smallest251.6 GB
DE
DeepSeek V4.1 Flash 1017 XQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
DE
DeepSeek V4.1 Flash UNCENSORED Protium
DeepSeek · Solstice-AI
Params748B
Context1024K
Q4_K_M426.1 GB
DE
DeepSeek V4.1 Flash
DeepSeek · AtomicChat
Params755B
Context—
Smallest365.7 GB
DE
deepseek-ai_deepseek-coder-33b-instruct
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
DE
DeepSeek V4.1 Flash
DeepSeek · smalinin
Params748B
Context—
Smallest0.8 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · lmstudio-community
Params284B
Context—
Smallest156.4 GB
DE
deepseek-ai_deepseek-coder-1.3b-instruct
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · mrfakename
Params1M
Context—
Q4_K_M444.7 GB
DE
DeepSeek V4.1 Flash 1017 GSQ agentic strata
DeepSeek · kaushikvira
Params14.7B
Context—
Smallest5.7 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · huihui-ai
Params1.68B
Context1024K
Smallest0.6 GB
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB