DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
asm2asm-deepseek-1.3b-300k
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
Deepseekr1Pro
DeepSeek · hunter0777
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · Lumia101
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
FL DeepseekCoder 6.7b Base IA3 20
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
DE
DeepSeek-V2-Lite-Chat
DeepSeek · adamo1139
Params15.7B
Context160K
Smallest8.9 GB
GGUF
DE
deepseek finetuning huanhuan
DeepSeek · bigspace001
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Deepseek 8b Jun 100rounds All
DeepSeek · laka12321
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
deepseekr1 14b transaction classifier
DeepSeek · RachitGupta2002
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest179.8 GB
ReasoningTool use
DE
DeepSeek 1.5b docker command finetune
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · SandLogicTechnologies
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Feilida Llama 8B 25022202
DeepSeek · xudongv2
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
modeloTFG_1.5B_6.1_GGUF
DeepSeek · West1125
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Smallest4.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · pyarn
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · rottenorchid
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · farpluto
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.7 GB
ReasoningTool use
DE
gguf 8B bnb 4bit 20231201 20250228
DeepSeek · nacckuk
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
Qwen2.5 32B DeepSeek R1 Instruct i1 Q2 K
DeepSeek · roleplaiapp
Params32.8B
Context32K
Smallest12.3 GB
ReasoningTool use
DE
deepseek v1.5b finetuned
DeepSeek · Typemaster32
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · ling1000T
Params671B
Context160K
Smallest244.1 GB
ReasoningTool use
DE
FL DeepseekCoder 6.7b Base IA3 15
DeepSeek · grupo4-bisite
Params6.74B
Context16K
Smallest3.8 GB
Coding
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest8.5 GB
CodingReasoningRoleplay
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · BenevolenceMessiah
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · BitStreamX
Params8.03B
Context128K
Smallest5.7 GB
ReasoningTool use
DE
model
DeepSeek · miao1991
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · BernTheCreator
Params7.62B
Context128K
Smallest4.4 GB
ReasoningTool use
DE
Deepseek
DeepSeek · karl413581003
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing