DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek-OCR
DeepSeek · forkjoin-ai
Params2.93B
Context—
Smallest2.1 GB
GGUF
DE
llama 8B ru
DeepSeek · xyzmean
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek Llm 7b Chat
DeepSeek · SandLogicTechnologies
Params6.91B
Context4K
Q4_K_M4.2 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest1.3 GB
CodingReasoningRoleplay
DE
DeepSeek R1 0528 CODER DRAFT 0.6B
DeepSeek · Gapeleon
Params590M
Context160K
Q4_K_M0.5 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Cran-May
Params7.62B
Context128K
Smallest5.4 GB
ReasoningTool use
DE
DeepSeek R1 Weather Control COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · DuoNeural
Params7.62B
Context128K
Smallest2.8 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek V2 Grand Horror SMB R1 Distill Llama 3.1 Uncensored 16.5B
DeepSeek · mradermacher
Params16.5B
Context128K
Q4_K_M10.0 GB
ReasoningTool use
DE
DeepSeek R1 DRAFT 0.5B
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Blunt
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
RoguePlanet DeepSeek R1 Qwen 32B RP
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
ReasoningRoleplay
DE
DeepSeek IT Support q4 k m v3
DeepSeek · elsonj
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · hardknocks
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest1.0 GB
CodingReasoningRoleplay
DE
Deepseek_ID_Legal_Preview_GGUF
DeepSeek · Azzindani
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
LegalLLM
DeepSeek · MosesTan281
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
goat deepseek llama 8b
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
lygo console models
DeepSeek · DeepSeekOracle
Params11.9B
Context2K
Smallest0.3 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepseekV4 Flash 20260731 DSpark
DeepSeek · am17an
Params19.8B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Medical Doctor
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek coder 6.7b instruct luau
DeepSeek · darwinkernelpanic
Params6.74B
Context16K
Smallest2.2 GB
Coding
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · grapevine-AI
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Mad Scientist 24B
DeepSeek · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningTool use
DE
Deepseek ai.DeepSeek R1 Zero.bf16
DeepSeek · DevQuasar-3
Params671B
Context160K
Smallest244.0 GB
ReasoningTool use
DE
Deepseek ai.DeepSeek V2.5 1210
DeepSeek · DevQuasar-5
Params236B
Context160K
Q4_K_M142.5 GB
Tool use

Keep browsing