DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
Deepseek Paraphrase
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepseekR1 Distill Uncensored L3 8B alt v1 i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Deepseek Coder V2 Lite 13B Instruct Sft Math7K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
deepseek coder 1.3b function calling v1
DeepSeek · pestova
Params1.35B
Context16K
Smallest2.7 GB
DE
Fathom-R1-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese Chat
DeepSeek · flypg
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B GTAP v3 Q4 K M
DeepSeek · DuoNeural
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek BlackRoot R1 Distill Llama 3.1 8B
DeepSeek · DavidAU
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 BF16
DeepSeek · XythicK
Params671B
Context160K
Q4_K_M404.4 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · yasserrmd
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek Coder V2 Instruct
DeepSeek · gaianet
Params236B
Context160K
Q4_K_M142.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek-R1-Distill-Qwen-32B
DeepSeek · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
DE
DeepSeek V4 Flash
DeepSeek · bullerwins
Params284B
Context1024K
Smallest88.0 GB
DE
Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 32B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
LoneStriker DeepSeek R1 Distill Llama 70B 8.0bpw h8 exl2 GGUF smashed
DeepSeek · PrunaAI
Params13M
Context128K
Q4_K_M0.0 GB
DE
DeepCoder-1.5B-Preview
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
DE
DeepSeek V4 Pro Qwen3.5 9B
DeepSeek · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
DE
natural sql 7b
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
NSFW FFS w hidden Deepseek Distill NSFW
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · n00b001
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
Deepseek Coder 1.3B Kexer
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 Distill Qwen 7B_OpenThoughts3
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB