DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
WF02 DeepSeek R1 7B
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek ai.DeepSeek Prover V2 7B
DeepSeek · DevQuasar
Params6.91B
Context64K
Q4_K_M4.2 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B 3.8
DeepSeek · bohugging
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek Ai Deepseek Coder 33b Instruct
DeepSeek · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
Coding
DE
DeepSeek R1 Medical FK
DeepSeek · Mr3yanpier
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B CODE SFT
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
DE
mirxa DeepSeek V4 Flash 0731
DeepSeek · mirxa2
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
deepseek medical i1
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · shad0wsh00ck
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V3 IQ1S
DeepSeek · cliecy
Params748B
Context1024K
Smallest223.8 GB
GGUF
DE
DeepSeek V2.5
DeepSeek · bullerwins
Params236B
Context160K
Q4_K_M142.5 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Mad Scientist 24B i1
DeepSeek · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningTool use
DE
DeepSeek R1 Llama 8B Abliterated
DeepSeek · PocketWeights
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 Distill Llama3B Hermes Turkish
DeepSeek · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
DE
deepseek math 10.8b rl
DeepSeek · mradermacher
Params10.8B
Context4K
Q4_K_M6.6 GB
GGUF
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · Keepser
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · osllmai-community
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill sthenno 14b 0121
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
asm2asm-deepseek-1.3b-200k
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V3 304 IQ1S
DeepSeek · cliecy
Params635B
Context1024K
Smallest201.6 GB
GGUF
DE
AXCXEPT.phi 4 Deepseek R1K RL EZO
DeepSeek · DevQuasar-8
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
DE
asm2asm deepseek1.3b xtokenizer armv8
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek V4 Flash 4Expert
DeepSeek · cloudyu
Params284B
Context64K
Smallest164.5 GB
GGUF
DE
DeepSeek TNG R1T2 Chimera
DeepSeek · ubergarm
Params672B
Context160K
Smallest142.7 GB
Tool use
DE
DeepSeek R1 DRAFT 0.6B v2.0
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
ReasoningTool use
DE
Deepseek R1 Distill Qwen2.5 Bakeneko 32b
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Bgl_Deepseek1_5B_Merged
DeepSeek · NidhiGupta23
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · ClaudioItaly
Params7.62B
Context128K
Smallest5.4 GB
ReasoningTool use

Keep browsing