DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 Medical COT Fine Tuned
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
DE
DeepSeek Magpie Reasoning 1.5b V2 250K CoTT
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepLink R1
DeepSeek · 3amthoughts
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
ThinkEdit deepseek qwen 14b
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
Deepseek R1 Qwen 7b Gold
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · BahamutRU
Params—
Context—
Smallest0.0 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · chuzka
Params284B
Context1024K
Smallest10.9 GB
DE
Sft Conta Deepseek Distill Qwen 7b
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen YARA Thinker 7B
DeepSeek · EryriLabs
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · testllmuser
Params14.8B
Context128K
Smallest10.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DavidAU.L3.1 MOE 2X8B Deepseek DeepHermes e32 13.7B
DeepSeek · DevQuasar-9
Params13.7B
Context128K
Q4_K_M8.3 GB
DE
DeepSeek R1 Distill Qwen 14B uncensored Q4 K M
DeepSeek · MrDevolver
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Farmer
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B_OpenThoughts3
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Weather Control v2 COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek r1 distill qwen 1 5b kto
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4 Flash MTP support
DeepSeek · opensota
Params284B
Context1024K
Smallest3.8 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · skratos115
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · GPT4All-Community
Params8.03B
Context128K
Smallest5.3 GB
DE
DeepSeek-V4-Pro-DSpark-Drafter
DeepSeek · dev7a
Params77.5B
Context1024K
Smallest26.6 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Sleepy303
Params755B
Context—
Smallest365.7 GB
DE
DeepSeek R1 Qwen 7B TCM
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
RPT DeepSeek R1 0528 Qwen3 8B
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek R1 Medical Doc Qwen3 8B_V1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest249.8 GB
DE
deepseek SFT history
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek-R1-Distill-Llama-8B
DeepSeek · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB