DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · lmstudio-community
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek V4 Flash 0731 reap 150b
DeepSeek · puwaer
Params150B
Context—
Smallest0.3 GB
DE
DeepSeek V4.1 Flash GSQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
DE
DeepSeek-V4.1-Flash-mixed-q2
DeepSeek · apetersson
Params552B
Context1024K
Smallest168.9 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · noteventhrice
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek OCR 2
DeepSeek · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek V4 Flash 0731 IK
DeepSeek · KeinNiemand
Params284B
Context—
Smallest65.4 GB
DE
DeepSeek V4.1 Flash 1017 dsx 2bit
DeepSeek · lxe
Params552B
Context—
Smallest148.1 GB
DE
deepseek-ai_deepseek-coder-33b-base
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
DE
DeepSeek OCR
DeepSeek · ggml-org
Params2.93B
Context—
Smallest3.1 GB
DE
DeepSeek V4.1 Flash 1017 dsx 2.6bit
DeepSeek · icecubetr
Params552B
Context—
Smallest187.6 GB
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · bartowski
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · lmstudio-community
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
deepseek llm 7B chat
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
deepseek-ai_deepseek-coder-5.7bmqa-base
DeepSeek · TheBloke
Params5.7B
Context16K
Q4_K_M3.4 GB
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek-ai_deepseek-coder-1.3b-base
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB