DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 1.5B Medical COT
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek
DeepSeek · Qian68
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V3.1
DeepSeek · gghfez
Params672B
Context160K
Smallest219.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · WaveCut
Params180B
Context1024K
Smallest57.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · jacobcarajo
Params32.8B
Context128K
Smallest23.3 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
Deepseek Coder 6.7b Instruct
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
DE
leviathan 16B final
DeepSeek · Chang-chih
Params15.7B
Context160K
Smallest10.4 GB
GGUF
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest6.7 GB
ReasoningTool use
DE
QwQ DeepSeek R1 SkyT1 Flash Lightest 32B
DeepSeek · sm54
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
Deepseek Coder 6.7b Base
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
DE
DeepSeek R1 wave COT 1.5B
DeepSeek · ming172
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · xxxx21313
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B FineTune Performance Enhancements
DeepSeek · CALISTA-INDUSTRY
Params1.78B
Context128K
Smallest3.6 GB
ReasoningTool use
DE
Phi 4 Deepseek R1K RL EZO
DeepSeek · mexicanamerican
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
DE
deepseek sql model
DeepSeek · 0xRichardH
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B abliterated
DeepSeek · thisnick
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek Llm 7b Chat
DeepSeek · gazem
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Fine Tuned_V1 LLM
DeepSeek · aurelio0rs1araujo
Params6.91B
Context4K
Smallest7.3 GB
Reasoning
DE
DeepSeek V2 Lite Chat
DeepSeek · phi0112358
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · YeonwooSung
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
leviathan chat 7b
DeepSeek · Chang-chih
Params6.91B
Context4K
Smallest4.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek R1 CAT Experimental
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 MQA
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · lordtachanka
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use

Keep browsing