DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
AStar Thought DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Deepseek ai.DeepSeek R1 0528 Qwen3 8B
DeepSeek · DevQuasar
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeekMath Base SFT Step DPO
DeepSeek · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · wtj111tz
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Medical Continual Pretrain Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B 3MPER0RR abliterated Q8 0
DeepSeek · 3MPER0RR
Params8.03B
Context128K
Smallest8.5 GB
Reasoning
DE
Huihui ai.DeepSeekR1 QwQ SkyT1 32B Fusion 715
DeepSeek · DevQuasar-5
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
mango deepseek41 dspark q8
DeepSeek · isilicon
Params14.2B
Context1024K
Smallest8.0 GB
GGUF
DE
Deepseek
DeepSeek · nisten
Params236B
Context160K
Smallest62.7 GB
GGUF
DE
DeepSeek V4 Flash 0731 DSpark
DeepSeek · singulared
Params19.8B
Context1024K
Smallest8.4 GB
GGUF
DE
DeepSeek V3 0324 DRAFT 0.5B
DeepSeek · mradermacher
Params501M
Context160K
Q4_K_M0.3 GB
ReasoningTool use
DE
GenBook Deepseek R1.Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · qwp4w3hyb
Params236B
Context160K
Smallest47.4 GB
Coding
DE
DeepSeek R1 Casino COT
DeepSeek · Smokeydk7
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek-V2-Lite-Chat
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek V4 Flash 0731 Ornstein
DeepSeek · GestaltLabs
Params284B
Context1024K
Q4_K_M163.6 GB
ReasoningTool use
DE
Qwen3 14B DSpark
DeepSeek · Anbeeld
Params2.64B
Context40K
Q4_K_M1.7 GB
ReasoningTool use
DE
CoderO1 DeepSeekR1 14B Preview
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingTool use
DE
Qwen2.5 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mmnga
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Qwen3 30B A3B Thinking Deepseek Distill 2507 v3.1 V2
DeepSeek · rodrigomt
Params30.5B
Context256K
Smallest13.8 GB
ReasoningTool use
DE
DeepSeek Prover V1.5 Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated cyber GLP 39 L1 39 a0.75
DeepSeek · msuiche
Params—
Context—
Smallest0.0 GB
GGUF
DE
deepSeek R1 Fine Tuned Medical
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek R1 Distill NSFW RP vRedux Proper i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
DE
DeepSeek R1 Medical COT LORA
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
ahmedheakl asm2asm deepseek 1.3b 100k x86 arm O2
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF

Keep browsing