DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · pbatra
Params7.62B
Context128K
Smallest4.4 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · RCorvalan
Params14.8B
Context128K
Smallest7.9 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat
DeepSeek · phi0112358
Params15.7B
Context160K
Smallest11.9 GB
GGUF
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params5376B
Context160K
Smallest462.5 GB
Reasoning
DE
DeepSeek V3.1 Terminus THIREUS IQ1 KT SPECIAL SPLIT
DeepSeek · Thireus
Params671B
Context160K
Smallest148.1 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat
DeepSeek · phi0112358
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest557.0 GB
ReasoningTool use
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params672B
Context160K
Smallest147.6 GB
Tool use
DE
Models Deepseek Ai DeepSeek R1 Distill Llama 8B
DeepSeek · Kaleemullah
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · kellywin
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Lddn Model Deepseek R1 Distill Llama 8b 2
DeepSeek · witbar
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B lora financial qa model
DeepSeek · li-long
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · raissadev
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
deepseek qwen 7b
DeepSeek · llmware
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
deepseek fortune
DeepSeek · zczhangchen
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
DeepSeek LLM 7B Chat Q8_0
DeepSeek · Asit03
Params6.91B
Context8K
Smallest7.3 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest34.3 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Alpaca FineTuned f16
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
DE
DeepSeek AutomateTrading
DeepSeek · heosanghun
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
DE
Bon deepseek r1 v1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek FGS 003
DeepSeek · seossine
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DE
DeepSeek R1 Medical COT Qwen 7B q4 k m
DeepSeek · andytoe
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
FL DeepseekCoder base vera 5 Q4 0
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
DE
deepseek medical4
DeepSeek · yyyyy11
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
DigitalLibrarySage
DeepSeek · yiyiFang
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
Deepseek 8b Jun
DeepSeek · laka12321
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.1
DeepSeek · leeminwaan
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
deepseek
DeepSeek · Nurman
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use

Keep browsing