DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · StephenGenusa
Params32.8B
Context128K
Smallest18.6 GB
ReasoningTool use
DE
DeepSeek V3.1 Terminus THIREUS Q5 0 R4 SPECIAL SPLIT
DeepSeek · Thireus
Params670B
Context160K
Smallest461.7 GB
GGUF
DE
Qwen2.5 32B
DeepSeek · 0xBasiliskAI
Params32.8B
Context128K
Smallest18.6 GB
ReasoningTool use
DE
DeepSeek R1 WXDATA QWEN 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
deepseek fortunetelling
DeepSeek · master8902
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · netcat420
Params8.19B
Context500K
Smallest3.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Distill_canton_medical5000_1024_nopacking
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · Lucy-in-the-Sky
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek IT Support q4 k m
DeepSeek · elsonj
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
cyberneurova Deepseek v4 flash
DeepSeek · cyberneurova
Params284B
Context1024K
Smallest161.9 GB
GGUF
DE
deepseek contract 1
DeepSeek · Crazyht530
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Infograb
DeepSeek · ghdi7662
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
HeatSeeker 284B A13B Lora
DeepSeek · UltimateIntent
Params826M
Context—
Smallest1.7 GB
GGUF
DE
DeepSeek R1 Distill Llama Tobacco 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSQL 1.0
DeepSeek · DeepSQL
Params1.78B
Context128K
Smallest3.6 GB
ReasoningTool use
DE
ALPACA DeepSeek R1 Distill Llama 8B LoRA Q8 0
DeepSeek · diposss
Params8.03B
Context128K
Smallest8.5 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B 500Steps GGUF Q4_K_M
DeepSeek · moslehGen
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
deepseek-math-7b-instruct
DeepSeek · joshnader
Params6.91B
Context4K
Smallest7.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
DE
DeepSeek V3.1 Terminus THIREUS IQ4 NL SPECIAL SPLIT
DeepSeek · Thireus
Params670B
Context160K
Smallest377.8 GB
GGUF
DE
Deepseek Moe 16b Chat
DeepSeek · Lucy-in-the-Sky
Params16.4B
Context4K
Smallest6.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · paultimothymooney
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
suanming deepseek 7b
DeepSeek · TINYTINYTINY
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
DeepSeek-V3.1-Terminus
DeepSeek · INC4AI
Params671B
Context160K
Smallest225.6 GB
ReasoningTool use
DE
Deepseek Math 7b Instruct
DeepSeek · Lucy-in-the-Sky
Params6.91B
Context4K
Smallest5.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · aplulu
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · elichen-skymizer
Params1.78B
Context128K
Smallest0.9 GB
ReasoningTool use
DE
DeepSeek V2 Lite Adapter
DeepSeek · HongKiet
Params287M
Context—
Smallest0.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest1.3 GB
CodingReasoningRoleplay
DE
deepseek r1 distill llama 70b
DeepSeek · cortexso
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use

Keep browsing