DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 1.5B Medical COT
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek
DeepSeek · Qian68
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V3.1
DeepSeek · gghfez
Params672B
Context160K
Smallest219.0 GB
DE
DeepSeek V4 Flash
DeepSeek · WaveCut
Params180B
Context1024K
Smallest57.3 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · jacobcarajo
Params32.8B
Context128K
Smallest23.3 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest16.7 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
DE
leviathan 16B final
DeepSeek · Chang-chih
Params15.7B
Context160K
Smallest10.4 GB
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest6.7 GB
DE
QwQ DeepSeek R1 SkyT1 Flash Lightest 32B
DeepSeek · sm54
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Medical COT Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
DE
Deepseek Coder 6.7b Base
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
DE
DeepSeek R1 wave COT 1.5B
DeepSeek · ming172
Params1.78B
Context128K
Smallest1.9 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · xxxx21313
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B FineTune Performance Enhancements
DeepSeek · CALISTA-INDUSTRY
Params1.78B
Context128K
Smallest3.6 GB
DE
Phi 4 Deepseek R1K RL EZO
DeepSeek · mexicanamerican
Params14.7B
Context16K
Q4_K_M9.1 GB
DE
deepseek sql model
DeepSeek · 0xRichardH
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B abliterated
DeepSeek · thisnick
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Deepseek Llm 7b Chat
DeepSeek · gazem
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 Fine Tuned_V1 LLM
DeepSeek · aurelio0rs1araujo
Params6.91B
Context4K
Smallest7.3 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · phi0112358
Params15.7B
Context160K
Smallest16.7 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · YeonwooSung
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
leviathan chat 7b
DeepSeek · Chang-chih
Params6.91B
Context4K
Smallest4.0 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest15.7 GB
DE
DeepSeek R1 CAT Experimental
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 MQA
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · lordtachanka
Params14.8B
Context128K
Smallest15.7 GB