DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash
DeepSeek · flaviodelgrosso
Params755B
Context—
Smallest365.7 GB
GGUF
DE
Phi 4 Deepseek R1K RL EZO
DeepSeek · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B to
DeepSeek · Lufel6848
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · wy8edhuh
Params8.19B
Context128K
Smallest4.8 GB
ReasoningTool use
DE
deepseek coder 1.3b python peft
DeepSeek · MadMarx37
Params1.35B
Context16K
Smallest1.0 GB
Coding
DE
DeepSeek R1 Distill Qwen 14B GRPO
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
fortunetelling
DeepSeek · chris2396
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 PSLE Comprehension
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Llama deepseek 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B Blunt Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Qwen2.5 1.5b SFT R1 JSON Unstructured To Structured
DeepSeek · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
ReasoningTool use
DE
Srini DeepSeek R1 Medical COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Distil Deepseek.V4.Pro.Minute.Codex.NSFW 0.1B
DeepSeek · zreozero
Params82M
Context1K
Q4_K_M0.1 GB
Reasoning
DE
DeepSeek V2 Lite FP8 BLOCK Fused
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Blunt Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Qwen deepseek 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek V4 Flash 0731 IQ2 M
DeepSeek · bluehawana
Params284B
Context1024K
Smallest104.0 GB
GGUF
DE
MawaredHR Deepseek
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest23.3 GB
CodingReasoningRoleplay
DE
DeepSeek V4 Flash
DeepSeek · jmilnz
Params284B
Context1024K
Smallest97.4 GB
ReasoningTool use
DE
Med Llama 3.2 1B DeepSeek67B Distilled
DeepSeek · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
DE
Volta Max uPLIft FP4 DeepSeek V4.1 Flash 1017 hot iq 8xV100 SXM2 PP2xTP4
DeepSeek · ProprietaryLegal
Params197B
Context—
Smallest110.6 GB
GGUF
DE
bgGPT DeepSeek R1 Distill Qwen 7B
DeepSeek · burgasdotpro
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
RAIF DeepSeek Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
Llama 3 ThinkRoleplay DeepSeek R1 Distill 8B abliterated
DeepSeek · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ReasoningRoleplay
DE
DeepSeek R1 0528 DQ4 K R4
DeepSeek · anikifoss
Params672B
Context160K
Smallest443.6 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 ROCmFP4
DeepSeek · kingjones777
Params304B
Context1024K
Smallest107.9 GB
ReasoningTool use
DE
RoguePlanet DeepSeek R1 Qwen 32B
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · double-em
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding

Keep browsing