DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Qwen2.5 DeepSeek R1 MFANN 7b
DeepSeek · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek Coder 6.7b Instruct
DeepSeek · LapinMalin
Params6.74B
Context16K
Smallest4.8 GB
Coding
DE
asm2asm deepseek 1.3b 100k arm x86 O2
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek V4 Flash Q8 0
DeepSeek · Preyazz
Params284B
Context1024K
Smallest302.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Q3 K L
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest37.1 GB
ReasoningTool use
DE
DeepSeek-V2
DeepSeek · mradermacher
Params236B
Context160K
Smallest47.4 GB
GGUF
DE
DeepSeek-V4-Flash-0731-DSpark-Drafter
DeepSeek · dev7a
Params19.8B
Context1024K
Smallest7.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated Q4 K M
DeepSeek · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Mlxha DeepSeek R1 Distill Llama 8B Notemplate
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Reasoning
DE
Deepseek Ai DeepSeek R1 0528 Qwen3 8B
DeepSeek · tensorblock
Params8.19B
Context128K
Smallest3.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · PowerServe
Params8B
Context128K
Smallest0.0 GB
ReasoningTool use
DE
asm2asm deepseek 1.3b 1M x86 O0 arm gnueabi gcc
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek V3.1 Terminus
DeepSeek · ling1000T
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ducu93
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek 7B
DeepSeek · ThePradip
Params7.62B
Context128K
Smallest3.9 GB
Tool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest5.4 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · lactroiii
Params70.6B
Context128K
Smallest44.3 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 Ombro v1
DeepSeek · Wladastic
Params284B
Context1024K
Smallest81.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · MR-CODESPIKE
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen3 4B Thinking 2507 DeepSeek v3.2 Speciale Code Distill
DeepSeek · SaitBurak
Params4.02B
Context256K
Smallest2.4 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased Reasoner i1
DeepSeek · Iambackup
Params70.6B
Context128K
Smallest49.9 GB
Reasoning
DE
DeepSeek R1 7B SYS
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B abliterated v2.Q4 K M
DeepSeek · Bluerosesbutterfly
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · TechnoByte
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek Coder 6.7b Instruct
DeepSeek · alphaduriendur
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
asm2asm deepseek1.3b arm xtokenizer q8 0
DeepSeek · ahmedheakl
Params1.35B
Context16K
Smallest1.4 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · ramagotchi
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
deepseek coder 1.6 7b
DeepSeek · lm-kit
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Q4 K S
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest40.3 GB
ReasoningTool use

Keep browsing