DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
deepseek-ai_deepseek-coder-1.3b-instruct
DeepSeek · Dzluck
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B Heretic
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
zralddeepseekv4.1
DeepSeek · Zrald
Params748B
Context1024K
Smallest264.5 GB
GGUF
DE
DeepSeek R1 Strategy Qwen 2.5 1.5b Unstructured To Structured
DeepSeek · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
DE
YoungAi DeepSeek V4.1 Flash
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
GGUF
DE
deepseek coder 7b instruct v1.5
DeepSeek · NightFox
Params6.91B
Context4K
Smallest5.7 GB
Coding
DE
DeepSeek V3 0324 CODER DRAFT 0.6B
DeepSeek · mradermacher
Params590M
Context160K
Q4_K_M0.5 GB
CodingTool use
DE
DeepSeek CAMTELAI Version1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek coder 7b instruct v1.5
DeepSeek · 21world
Params6.91B
Context4K
Smallest4.0 GB
Coding
DE
Deepseek Moe 16b Chat
DeepSeek · MIThridate
Params16.4B
Context4K
Q4_K_M9.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO Backbone IQ2 XXS Engram IQ4 NL
DeepSeek · Rikunarita
Params748B
Context1024K
Smallest249.2 GB
ReasoningTool useVision
DE
Nemotron-Research-Reasoning-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat ReMoE
DeepSeek · Zhu149248
Params15.7B
Context160K
Smallest16.7 GB
Tool use
DE
CoderO1 DeepSeekR1 Coder 14B Preview
DeepSeek · RDson
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingTool use
DE
FuseO1 QwQ DeepSeekR1 LightR1 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Dspark_Gemma4_12B
DeepSeek · williamliao
Params1.28B
Context256K
Q4_K_M0.8 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 ream 200b
DeepSeek · puwaer
Params200B
Context1024K
Smallest0.3 GB
GGUF
DE
CoderO1 DeepSeekR1 14B Preview v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingTool use
DE
CoCoS Deepseek Coder 1.3b Base
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
Srijith rkr deepseek base 1e 4 NO cot all samples 300 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · baibairui
Params284B
Context1024K
Smallest86.7 GB
ReasoningTool use
DE
Deepseek Ai DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · ThalisAI
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
Qwen2.5 7B DeepSeek R1 1M i1
DeepSeek · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
ReasoningTool use
DE
RoguePlanet DeepSeek R1 Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
deepseek-coder-7b-instruct-v1.5
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
KSU HW SEC Deepseek SFT RL Text AST
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DE
Srijith rkr deepseek base 1e 4 NO cot all samples 3 epoch
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Abliterated v2
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use

Keep browsing