DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 32B GuiyangGuian Lora v1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek V3.1 Terminus THIREUS IQ4 XS SPECIAL SPLIT
DeepSeek · Thireus
Params671B
Context160K
Smallest356.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest7.9 GB
CodingReasoningRoleplay
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest284.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · Iambackup
Params8.03B
Context128K
Smallest6.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
DE
Tianqiao DeepSeek 7B Math Compare Answer
DeepSeek · tensorblock
Params6.89B
Context4K
Smallest2.7 GB
GGUF
DE
th reasoning 04 deepseek1.5b post GRPO
DeepSeek · RJTPP
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest75.0 GB
CodingReasoningRoleplay
DE
Qwen2.5 32B DeepSeek R1 Instruct i1 IQ3 M
DeepSeek · roleplaiapp
Params32.8B
Context32K
Smallest14.8 GB
ReasoningTool use
DE
deepseek medical
DeepSeek · yaobo2816
Params8.03B
Context128K
Smallest8.5 GB
GGUF
DE
DeepSeek R1 Medical COT Qwen 1.5B Gguf
DeepSeek · jiangcongtao
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek V4 Flash DSpark draft Q3 K S
DeepSeek · him0413
Params19.8B
Context1024K
Smallest8.5 GB
GGUF
DE
DeepSeek-Coder-V2-Base
DeepSeek · mradermacher
Params236B
Context160K
Smallest47.4 GB
Coding
DE
QwQ DeepSeek R1 SkyT1 Flash Light 32B
DeepSeek · sm54
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek Prover V1.5 RL
DeepSeek · arbius
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 0528
DeepSeek · gghfez
Params672B
Context160K
Smallest302.5 GB
ReasoningTool use
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32B
Context128K
Smallest39.9 GB
Reasoning
DE
tabehsonati v3
DeepSeek · Danielrahmai1991
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest366.8 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · putao886
Params—
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · nguyenthilaitrieulong
Params70.6B
Context128K
Smallest48.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen MFANN Slerp 7b
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
v1 deepseek instruct
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V3 0324 MoE Pruner E192 q8 0
DeepSeek · tflsxyy
Params508B
Context160K
Smallest539.5 GB
Tool use
DE
Deepseek 0329
DeepSeek · fkasljkfaslkfj
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT Guff Q4 k m
DeepSeek · adityaR007
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Medical Distill Qwen 1.5B Alvin0619 GGUF3
DeepSeek · Alvin-LiuJia
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
Deepseek R1 Qwen3 8b Indonesian Math Qa
DeepSeek · budf93
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · windy88
Params284B
Context1024K
Smallest3.8 GB
GGUF

Keep browsing