DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mohanz
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.9 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · eouya2
Params220B
Context1024K
Smallest68.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Hobaks
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · professorf
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek-V3.1
DeepSeek · AmpereComputing
Params671B
Context160K
Smallest676.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest40.3 GB
CodingReasoningRoleplay
DE
Die Walkure R1 Q7B iQ4 K M
DeepSeek · IntelligentEstate
Params7.62B
Context128K
Smallest4.7 GB
ReasoningTool use
DE
Fypfine Tuned_Deepseek_Q4_K_M
DeepSeek · liiiiiiiee
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek-V3-0324
DeepSeek · bobchenyx
Params671B
Context160K
Q4_K_M409.8 GB
Tool use
DE
DeepSeek SmartContractVulnDetect Quantized
DeepSeek · Hawks-vision
Params6.74B
Context16K
Q4_K_M4.1 GB
ReasoningVision
DE
Deepseek R1 Distill 1.5B code instruct
DeepSeek · ertghiu256
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
DE
lumynax reasoning deepseek prover v2 671b
DeepSeek · AbteeXAILab
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
DE
DeepSeek DQ3 K M
DeepSeek · UnicomAI
Params671B
Context160K
Smallest300.8 GB
ReasoningTool use
DE
DeepSeek Prover V2 GGUF IQ1 S
DeepSeek · lovedheart
Params671B
Context160K
Smallest134.6 GB
Tool use
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params5376B
Context160K
Smallest268.6 GB
GGUF
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params660B
Context160K
Smallest147.9 GB
Reasoning
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest200.1 GB
ReasoningTool use
DE
Orivus Architect v1 7B Lite
DeepSeek · orivus
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · stajerc
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Willcb DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
Reasoning
DE
story_reward_DeepSeek_8B_v1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
DeepSeek V2 Lite
DeepSeek · ttxxhh
Params15.7B
Context160K
Smallest8.9 GB
GGUF
DE
BoT DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V4 Flash 160t2 UD IQ1 S
DeepSeek · siendsi
Params180B
Context1024K
Smallest54.2 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · Ffftdtd5dtft
Params15.7B
Context160K
Smallest6.4 GB
Coding
DE
DSV4 Flash 0731 ablit anchored GUFF
DeepSeek · dicksondickson
Params284B
Context1024K
Smallest86.7 GB
ReasoningTool use

Keep browsing