DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
ReasoningTool use
DE
deepseek coder 33b instruct pythagora v3
DeepSeek · LoupGarou
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
Qwen2.5 3B Distillation DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
ReasoningTool use
DE
DeepSeek Prover V2 7B
DeepSeek · mradermacher
Params6.91B
Context64K
Q4_K_M4.2 GB
Tool use
DE
RM R1 DeepSeek Distilled Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
deepseek llm 67b Spicy 3.1 1
DeepSeek · LoneStriker
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
DE
zen5 pro
DeepSeek · zenlm
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B korean reasoning
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Llama 3 LewdPlay evo DeepSeek R1 Distill 8B i1
DeepSeek · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
DE
EOPSA DeepSeek R1 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
deepseek coder 7b instruct v1.5
DeepSeek · brittlewis12
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
Openbuddy Deepseek 67b v15.3
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
FairyR1-32B
DeepSeek · Mungert
Params32.8B
Context128K
Q4_K_M19.8 GB
ReasoningTool use
DE
DeepSeek Grand Horror SMB R1 Distill Llama 3.1 16B
DeepSeek · DavidAU
Params15.7B
Context128K
Q4_K_M9.5 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 Distill Merge Qwen Math 1.5Bb
DeepSeek · mradermacher
Params1.78B
Context4K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek Ai Deepseek Coder 1.3b Instruct
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
Coding
DE
Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
CodingReasoning
DE
DeepSeek OCR 2
DeepSeek · 42ailab
Params2.93B
Context8K
Q4_K_M2.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.4 GB
GGUF
DE
Deepseek Math 7b Rl
DeepSeek · matrixportalx
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Srijith rkr deepseek base 1e 3 NO cot only failed samples 100 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 DRAFT 0.6B v3.0
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
Reasoning
DE
deepseek-coder-1.3b-python-peft
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
Deepseek Coder V2 Lite 13B Instruct Sft Math7K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Deepseek Coder 6.7b Base 20241020
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek V4 Flash
DeepSeek · datayoda
Params284B
Context1024K
Smallest90.3 GB
CodingReasoningTool use
DE
RAIF DeepSeek Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Openbuddy Deepseek 67b v15.3
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF

Keep browsing