DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek Prover V1.5 RL
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Srijith rkr deepseek base 1e 3 NO cot all samples 700 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4 Flash 0731 DSpark Drafter IQ1M IQ2XXS
DeepSeek · Unkto
Params19.8B
Context1024K
Smallest4.8 GB
GGUF
DE
Srijith rkr deepseek base 1e 3 YES cot only failed samples 3 epoch
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Psychology COT
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
CodeFuse DeepSeek 33B
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
ThinkEdit deepseek llama3 8b i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · tarruda
Params284B
Context1024K
Smallest0.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · ijohn07
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingTool use
DE
DeepSeek R1 Distill Llama 8B SLMJ
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Openbuddy Deepseek 67b v15.2
DeepSeek · RichardErkhov
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
DE
DeepSeek V4 Flash 0731 Fractal 64GB CPU
DeepSeek · Synchopate
Params284B
Context1024K
Smallest60.7 GB
GGUF
DE
DeepSeekMath 7B MathFusion
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4 Flash 0731 abliterated lora
DeepSeek · Sabomako
Params2.16B
Context—
Smallest1.8 GB
GGUF
DE
AymanTarig deepseek coder 1.3b FC v1
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · Kay6888
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Total04 DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · fairy322
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
L3.1 MOE 2X8B Deepseek DeepHermes e32 13.7B
DeepSeek · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
ReasoningTool use
DE
DeepSeek R1 Qwen3 8B ToT Merged
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 1 5b ft AstroPhysics CoT
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Fine Tuned_V4 PCB
DeepSeek · aurelio0rs1araujo
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
Mixtral 8x7B DeepSeek R1 Distill
DeepSeek · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingReasoning
DE
DeepSeek R1 Distill Llama 8B Unsloth Bnb 4bit
DeepSeek · ahsanf
Params8.03B
Context128K
Smallest16.1 GB
Reasoning
DE
DeepSeek R1 lottery
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B LIMO i1
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek Qwen2.5 7B Redistil
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
RM R1 DeepSeek Distilled Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek R1 Distill 14B Code Ft
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use

Keep browsing