DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek Coder V2 Lite Base
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
Deepseek_Coder
DeepSeek · shehrozashoaib
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
Deepseek Coder 1.3b Base
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · fcvcggvvv
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · AbteeXAILab
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek FreedomIntelligence medical o1 reasoning SFT
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
deepseek rust 1.3b lora
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
deepseek coder v2 inst cpu optimized
DeepSeek · Ocean82
Params236B
Context160K
Smallest128.0 GB
DE
DeepSeek R1 Distill Qwen 32B abliterated Q4 K M
DeepSeek · kagevazquez
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · Savyasaachin
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
mango deepseek41 gsq engram
DeepSeek · isilicon
Params197B
Context—
Smallest110.6 GB
DE
internlm.OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Qwen3.5 9B Deepseek reasoning unlimited
DeepSeek · sulpikar2
Params8.95B
Context256K
Smallest17.9 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · sokann
Params284B
Context1024K
Smallest101.0 GB
DE
deepseek deepseek r1 distill 8b
DeepSeek · cPilotGod
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Openbuddy Deepseek 67b v18.1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · Fastiraz
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Medical COT zh
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 3B HalfGod
DeepSeek · linkyfan
Params3.21B
Context128K
Smallest3.4 GB
DE
Openbuddy Deepseek 67b v18.1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · ysn-rfd
Params7.62B
Context128K
Smallest4.4 GB
DE
DeepSeek-V2-Lite-sft-commonsense15k
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek prm
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Diferimento
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Llama3.1 8B ORM Deepseek Data
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Mental_DeepSeek 8B Mix Sft
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
S1.1 R1 T1 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Bon deepseek r1 v02
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB