DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
reason1
DeepSeek · maplerxyz1
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
qwenr1teacher
DeepSeek · Hlias11
Params2.2B
Context—
Q4_K_M1.3 GB
Reasoning
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest7.3 GB
ReasoningTool use
DE
Deepseek Llm 7b Chat
DeepSeek · Morgen0052
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp BF16
DeepSeek · cvgro
Params284B
Context1024K
Smallest156.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest5.6 GB
CodingReasoningRoleplay
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · spachava
Params15.7B
Context160K
Smallest16.7 GB
Coding
DE
DeepSeek V4 Flash Q8xQ5
DeepSeek · setar007
Params284B
Context1024K
Smallest198.4 GB
GGUF
DE
ExpThink DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
deepseek r1 overthinking
DeepSeek · leonvanbokhorst
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash MTP support
DeepSeek · eadx
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Wordle RL
DeepSeek · mradermacher
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen3 0.6B
DeepSeek · ASomeoneWhoInterestedWithAI
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
DE
lumynax reasoning deepseek r1 qwen 7b
DeepSeek · AbteeXAILab
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Qwen2.5 14B DeepSeek r128
DeepSeek · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
DE
Sofistik Qwen3 8B Reasoning
DeepSeek · Vovenzza
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B sanguohaha
DeepSeek · ningxx
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek-V2-Lite-Chat
DeepSeek · nightcatsong
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
DeepSeek V4 Flash 0731 Ombro v3c
DeepSeek · Wladastic
Params284B
Context1024K
Smallest85.8 GB
GGUF
DE
DeepSeek-V2-Chat
DeepSeek · mradermacher
Params236B
Context160K
Smallest47.4 GB
GGUF
DE
DeepSeek R1 Distill Alpaca FineTuned Q3 K M
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
ReasoningTool use
DE
Internlm OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
DE
modeloTFG_7B_4.1_GGUF
DeepSeek · West1125
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V2.5 1210
DeepSeek · AbteeXAILab
Params236B
Context160K
Q4_K_M142.5 GB
CodingTool use
DE
ThinkEdit deepseek llama3 8b
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · MaxGH2023
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · havenwood
Params32.8B
Context128K
Smallest23.3 GB
ReasoningTool use
DE
deepseek_llama8B_disaster
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
asm2asm deepseek1.3b xtokenizer armv8
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
DE
deepseek korean
DeepSeek · PAUL1122
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use

Keep browsing