DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mohanz
Params14.8B
Context128K
Smallest10.3 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest8.1 GB
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.9 GB
DE
DeepSeek V4 Flash
DeepSeek · eouya2
Params220B
Context1024K
Smallest68.6 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Hobaks
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · professorf
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Deepseek-V3.1
DeepSeek · AmpereComputing
Params671B
Context160K
Smallest676.6 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest40.3 GB
DE
Die Walkure R1 Q7B iQ4 K M
DeepSeek · IntelligentEstate
Params7.62B
Context128K
Smallest4.7 GB
DE
Fypfine Tuned_Deepseek_Q4_K_M
DeepSeek · liiiiiiiee
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Deepseek-V3-0324
DeepSeek · bobchenyx
Params671B
Context160K
Q4_K_M409.8 GB
DE
DeepSeek SmartContractVulnDetect Quantized
DeepSeek · Hawks-vision
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
Deepseek R1 Distill 1.5B code instruct
DeepSeek · ertghiu256
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
lumynax reasoning deepseek prover v2 671b
DeepSeek · AbteeXAILab
Params671B
Context160K
Q4_K_M404.5 GB
DE
DeepSeek DQ3 K M
DeepSeek · UnicomAI
Params671B
Context160K
Smallest300.8 GB
DE
DeepSeek Prover V2 GGUF IQ1 S
DeepSeek · lovedheart
Params671B
Context160K
Smallest134.6 GB
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params5376B
Context160K
Smallest268.6 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params660B
Context160K
Smallest147.9 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest200.1 GB
DE
Orivus Architect v1 7B Lite
DeepSeek · orivus
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · stajerc
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Willcb DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
DE
story_reward_DeepSeek_8B_v1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek V2 Lite
DeepSeek · ttxxhh
Params15.7B
Context160K
Smallest8.9 GB
DE
BoT DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash 160t2 UD IQ1 S
DeepSeek · siendsi
Params180B
Context1024K
Smallest54.2 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · Ffftdtd5dtft
Params15.7B
Context160K
Smallest6.4 GB
DE
DSV4 Flash 0731 ablit anchored GUFF
DeepSeek · dicksondickson
Params284B
Context1024K
Smallest86.7 GB