DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
R2 DeepSeek V4 Flash 0731 TQ3 4S
DeepSeek · YTan2000
Params284B
Context1024K
Smallest97.0 GB
GGUF
DE
Deepseek R1 Qwen 1.5B
DeepSeek · kolosal
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · YeonwooSung
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · WaveCut
Params146B
Context1024K
Smallest47.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · PowerServe
Params8B
Context128K
Smallest0.0 GB
ReasoningTool use
DE
Cybersecurity attck DeepSeek R1 Distill Llama 8B
DeepSeek · tiangler
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · pbatra
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
DE
DeepSeek Qwen2.5 3B WebInstruct CFT 50K
DeepSeek · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · wszgrcy
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest14.1 GB
Coding
DE
DeepSeek-V2-Lite-Chat
DeepSeek · larenspear
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · mradermacher
Params236B
Context160K
Smallest47.4 GB
Coding
DE
Deepseek 0528 Half
DeepSeek · linkyfan
Params8.19B
Context40K
Q4_K_M1.1 GB
GGUF
DE
Qwen3 30B A3B Thinking 2507 Deepseek v3.1 Distill FP32
DeepSeek · rovnerivan
Params30.5B
Context256K
Smallest21.1 GB
CodingReasoningTool use
DE
migtissera DeepSeek Coder V2 Base
DeepSeek · RichardErkhov
Params230B
Context—
Smallest0.0 GB
Coding
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · Joseph717171
Params8.03B
Context128K
Smallest6.9 GB
ReasoningTool use
DE
Deepseek Moe 16b
DeepSeek · MikeKuykendall
Params16.4B
Context4K
Smallest17.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · paultimothymooney
Params7.62B
Context128K
Smallest5.3 GB
ReasoningTool use
DE
finetuned deepseek medical
DeepSeek · YoojongChoi
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
deepseekr1new q4 k m
DeepSeek · peteparker456
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen2.5 1.5B DeepSeek R1 Dare_Linear
DeepSeek · pravdin
Params1.78B
Context32K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Main
DeepSeek · bufanlin
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 DSpark Selective Q4 K M
DeepSeek · Ralii
Params19.8B
Context1024K
Smallest10.6 GB
GGUF
DE
deepseek r1 1.5b
DeepSeek · ashwinij2
Params1.78B
Context128K
Smallest1.1 GB
ReasoningTool use
DE
DeepSeek R1 14B Finetuned
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek-R1-0528
DeepSeek · moxin-org
Params671B
Context160K
Smallest200.0 GB
ReasoningTool use
DE
DeepSeek V4 4B Toy
DeepSeek · Bert504
Params4.08B
Context1024K
Smallest2.6 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · kaetemi
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
deepseek r1 lawer
DeepSeek · kongqing
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use

Keep browsing