DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
DE
deepseek coder 33b instruct pythagora v3
DeepSeek · LoupGarou
Params33.3B
Context16K
Q4_K_M19.9 GB
DE
Qwen2.5 3B Distillation DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
DeepSeek Prover V2 7B
DeepSeek · mradermacher
Params6.91B
Context64K
Q4_K_M4.2 GB
DE
RM R1 DeepSeek Distilled Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
deepseek llm 67b Spicy 3.1 1
DeepSeek · LoneStriker
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
zen5 pro
DeepSeek · zenlm
Params284B
Context1024K
Smallest3.8 GB
DE
DeepSeek R1 Distill Llama 8B korean reasoning
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Llama 3 LewdPlay evo DeepSeek R1 Distill 8B i1
DeepSeek · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
EOPSA DeepSeek R1 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
deepseek coder 7b instruct v1.5
DeepSeek · brittlewis12
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Openbuddy Deepseek 67b v15.3
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
FairyR1-32B
DeepSeek · Mungert
Params32.8B
Context128K
Q4_K_M19.8 GB
DE
DeepSeek Grand Horror SMB R1 Distill Llama 3.1 16B
DeepSeek · DavidAU
Params15.7B
Context128K
Q4_K_M9.5 GB
DE
DeepSeek R1 Distill Merge Qwen Math 1.5Bb
DeepSeek · mradermacher
Params1.78B
Context4K
Q4_K_M1.1 GB
DE
Deepseek Ai Deepseek Coder 1.3b Instruct
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
DE
Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek OCR 2
DeepSeek · 42ailab
Params2.93B
Context8K
Q4_K_M2.0 GB
DE
DeepSeek V4.1 Flash 1017 EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.4 GB
DE
Deepseek Math 7b Rl
DeepSeek · matrixportalx
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Srijith rkr deepseek base 1e 3 NO cot only failed samples 100 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 DRAFT 0.6B v3.0
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
DE
deepseek-coder-1.3b-python-peft
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
Deepseek Coder V2 Lite 13B Instruct Sft Math7K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
Deepseek Coder 6.7b Base 20241020
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek V4 Flash
DeepSeek · datayoda
Params284B
Context1024K
Smallest90.3 GB
DE
RAIF DeepSeek Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Openbuddy Deepseek 67b v15.3
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB