DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 DRAFT 0.6B v3.0
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
Reasoning
DE
Models Sszymczyk DeepSeek V3.2 4Layers F32
DeepSeek · sszymczyk
Params15.2B
Context160K
Smallest16.1 GB
GGUF
DE
Deepseeker Kunou Qwen2.5 14b
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DE
deepseek Sunfall Merged Model
DeepSeek · Baskar2005
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 ds4
DeepSeek · nazeshinjite
Params19.8B
Context—
Smallest8.4 GB
GGUF
DE
DeepSeek R1 Qwen Coder 8B Q4 K M
DeepSeek · Alptekinege
Params8.16B
Context128K
Q4_K_M5.0 GB
CodingReasoningTool use
DE
Deepseek R1 Distill NSFW RP vRedux Proper
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · rbinrs
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 3B
DeepSeek · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Reasoning
DE
S1.1 DeepSeek R1 Bespoke 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepseekV4 0.5b
DeepSeek · gggff123
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
DE
Elderflower 1.5B
DeepSeek · Noid3a-Labs
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek R1 Distill NSFW RP vRedux i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 johnny five v5 DeepSeek r1 4bit
DeepSeek · S4MPL3BI4S
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen Medical
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek R1 8B MikroTik Distilled
DeepSeek · vivek-dodia
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · LoneStriker
Params236B
Context160K
Q4_K_M142.5 GB
Coding
DE
DeepSeek R1 Distill Qwen 32B FineTune
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
Deepseek Ai Deepseek Math 7b Rl
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
DE
medical inference
DeepSeek · BEncoderRT
Params8.03B
Context128K
Smallest8.5 GB
CodingReasoningTool use
DE
DeepSeek R1 Drone logistics COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · BambiSunny
Params1M
Context—
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V6d codezh mixed192 IQ2XS
DeepSeek · cliecy
Params477B
Context1024K
Smallest199.2 GB
GGUF
DE
DeepSeek R1 32B CodeSecurity New
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Deepseekmath 7b Sft MATH v2
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek-R1-Distill-Llama-8B-Ablation
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B uncensored
DeepSeek · thirdeyeai
Params7.62B
Context128K
Smallest3.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Persian
DeepSeek · modashtizade
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use

Keep browsing