DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Medical COT Fine Tuned
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
ReasoningTool use
DE
DeepSeek Magpie Reasoning 1.5b V2 250K CoTT
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepLink R1
DeepSeek · 3amthoughts
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
DE
ThinkEdit deepseek qwen 14b
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek R1 Qwen 7b Gold
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · BahamutRU
Params—
Context—
Smallest0.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · chuzka
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
Sft Conta Deepseek Distill Qwen 7b
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen YARA Thinker 7B
DeepSeek · EryriLabs
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · testllmuser
Params14.8B
Context128K
Smallest10.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DavidAU.L3.1 MOE 2X8B Deepseek DeepHermes e32 13.7B
DeepSeek · DevQuasar-9
Params13.7B
Context128K
Q4_K_M8.3 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B uncensored Q4 K M
DeepSeek · MrDevolver
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Farmer
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B_OpenThoughts3
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Weather Control v2 COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek r1 distill qwen 1 5b kto
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash MTP support
DeepSeek · opensota
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · skratos115
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · GPT4All-Community
Params8.03B
Context128K
Smallest5.3 GB
ReasoningTool use
DE
DeepSeek-V4-Pro-DSpark-Drafter
DeepSeek · dev7a
Params77.5B
Context1024K
Smallest26.6 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash
DeepSeek · Sleepy303
Params755B
Context—
Smallest365.7 GB
GGUF
DE
DeepSeek R1 Qwen 7B TCM
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
RPT DeepSeek R1 0528 Qwen3 8B
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Medical Doc Qwen3 8B_V1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest249.8 GB
ReasoningTool use
DE
deepseek SFT history
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek-R1-Distill-Llama-8B
DeepSeek · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
ReasoningTool use

Keep browsing