DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek R1 Distill Qwen2.5 Bakeneko 32b
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
DE
DeepSeek IT Support q4 k m v5
DeepSeek · elsonj
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
WinEvent Triage Reasoner 14B
DeepSeek · edelucia
Params14.8B
Context128K
Smallest9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · JASONWORLD
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek Moe 16b
DeepSeek · MikeKuykendall
Params16.4B
Context4K
Smallest32.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · matrixportalx
Params7.62B
Context128K
Smallest3.6 GB
ReasoningTool use
DE
Lane
DeepSeek · Zarkdrd
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · matrixportalx
Params7.62B
Context128K
Smallest3.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest8.1 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · ReallyFloppyPenguin
Params32.8B
Context128K
Smallest18.6 GB
ReasoningTool use
DE
Qwen2.5 14B DeepSeek R1 1M i1 IQ3 M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest6.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · BernTheCreator
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
DE
Deepseek R1 Distill Qwen 14b Unsloth Bnb 4bit
DeepSeek · AlSamCur123
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B ABUB ST
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · RCorvalan
Params8.03B
Context128K
Smallest6.6 GB
ReasoningTool use
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · tachyphylaxis
Params672B
Context160K
Smallest139.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · lactroiii
Params8.03B
Context128K
Smallest6.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B abliterated Q8 0
DeepSeek · drmcbride
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.7 GB
CodingReasoningRoleplay
DE
Deepseek Math 7b Instruct
DeepSeek · SkyNotion
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · Iambackup
Params14.8B
Context128K
Smallest12.1 GB
ReasoningTool use
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · kepom
Params284B
Context1024K
Smallest98.8 GB
GGUF
DE
asm2asm deepseek 1.3b 500k 4ep x86 O0 arm gnueabi gcc
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
DE
deepseek
DeepSeek · bilisimhocasi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
deepseekmerge 7b ties
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
MLMLML
DeepSeek · percyraskova
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
Qwen2.5 14B DeepSeek R1 1M Q4 0
DeepSeek · msyukorai
Params14.8B
Context986K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek V2 Lite
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Cran-May
Params1.78B
Context128K
Smallest1.1 GB
ReasoningTool use

Keep browsing