DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · pbatra
Params7.62B
Context128K
Smallest4.4 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · RCorvalan
Params14.8B
Context128K
Smallest7.9 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · phi0112358
Params15.7B
Context160K
Smallest11.9 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params5376B
Context160K
Smallest462.5 GB
DE
DeepSeek V3.1 Terminus THIREUS IQ1 KT SPECIAL SPLIT
DeepSeek · Thireus
Params671B
Context160K
Smallest148.1 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · phi0112358
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest557.0 GB
DE
DeepSeek V3 0324
DeepSeek · Thireus
Params672B
Context160K
Smallest147.6 GB
DE
Models Deepseek Ai DeepSeek R1 Distill Llama 8B
DeepSeek · Kaleemullah
Params8.03B
Context128K
Smallest16.1 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · kellywin
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Lddn Model Deepseek R1 Distill Llama 8b 2
DeepSeek · witbar
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B lora financial qa model
DeepSeek · li-long
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · raissadev
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
deepseek qwen 7b
DeepSeek · llmware
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
deepseek fortune
DeepSeek · zczhangchen
Params7.62B
Context128K
Smallest8.1 GB
DE
DeepSeek LLM 7B Chat Q8_0
DeepSeek · Asit03
Params6.91B
Context8K
Smallest7.3 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest34.3 GB
DE
DeepSeek R1 Distill Alpaca FineTuned f16
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest16.1 GB
DE
DeepSeek AutomateTrading
DeepSeek · heosanghun
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Bon deepseek r1 v1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek FGS 003
DeepSeek · seossine
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Medical COT Qwen 7B q4 k m
DeepSeek · andytoe
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
FL DeepseekCoder base vera 5 Q4 0
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
DE
deepseek medical4
DeepSeek · yyyyy11
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DigitalLibrarySage
DeepSeek · yiyiFang
Params8.03B
Context128K
Smallest8.5 GB
DE
Deepseek 8b Jun
DeepSeek · laka12321
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.1
DeepSeek · leeminwaan
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
deepseek
DeepSeek · Nurman
Params3.09B
Context32K
Q4_K_M1.9 GB