DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
AtomicChat DeepSeek V4.1 Flash 1017 IQ2 XXS llama cpp
DeepSeek · teggr234
Params748B
Context1024K
Smallest248.8 GB
ReasoningTool use
DE
DeepSeek R1 Amms Chatbot
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Blunt Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek R1 1.5B Q
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 SpamAssassin
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
asm2asm deepseek1.3b xtokenizer arm
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
DE
Deepseek Ai Deepseek Coder 5.7bmqa Base
DeepSeek · tensorblock
Params5.7B
Context16K
Smallest2.1 GB
Coding
DE
Purple Squirrel R1 Fp16
DeepSeek · purplesquirrelnetworks
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest4.1 GB
CodingReasoningRoleplay
DE
Deepseek Coder 1.3b Instruct
DeepSeek · SkyNotion
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest23.3 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 Abliteration LoRA
DeepSeek · pp111asd
Params115M
Context—
Smallest0.5 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · nguyenthdat
Params530B
Context1024K
Smallest138.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · Duhvil
Params552B
Context1024K
Smallest120.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B FineTune
DeepSeek · rizkysulaeman
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
DE
DeepSeek R1 DeepSeek R1 MedChatZH
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Electrical engineering
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct Q4 K M
DeepSeek · criscar22
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Shanet2004
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Qwen 3 Reasoning Combination With Deepseek
DeepSeek · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 refusal direction dsv41 cvec
DeepSeek · cjxzdzh
Params—
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · ngeng
Params552B
Context1024K
Smallest120.7 GB
ReasoningTool use
DE
DeepSeekMath 7B ScaleQuest
DeepSeek · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
DE
bgGPT DeepSeek R1 Distill Qwen 14B
DeepSeek · burgasdotpro
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest15.7 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 14B uncensored Q8 0
DeepSeek · bhismaperkasa
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · alphaduriendur
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
deepseek moe 16b topo cbp merged
DeepSeek · frankmorales2020
Params16.4B
Context4K
Q4_K_M10.9 GB
GGUF
DE
Huihui Ai DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
Chimera DeepSeek NSFW 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use

Keep browsing