DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 QWen7B Medical COT
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
FinSenti DeepSeek R1 1.5B
DeepSeek · Ayansk11
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek 8B Finetuned Medical O1 Reasoning SFT Q8 0
DeepSeek · NikkeS
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest18.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mpkmkk
Params14.8B
Context128K
Smallest12.1 GB
ReasoningTool use
DE
asm2asm deepseek1.3b arm xtokenizer q5
DeepSeek · ahmedheakl
Params1.35B
Context16K
Smallest1.0 GB
GGUF
DE
asm2asm deepseek 1.3b 500k 4ep x86 O0 arm gnueabi gcc
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek R1 fine tuned v1 PCB
DeepSeek · FabioSantos
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat
DeepSeek · JenniSD
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
DeepSeek R1 Fava 50 COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · yoursaryan
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Jianyuan1 Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · FuseAI
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Openbuddy Deepseek 67b v18.1
DeepSeek · RichardErkhov
Params67.4B
Context4K
Q4_K_M28.4 GB
GGUF
DE
Models DavidAU DeepSeek Grand Horror SMB R1 Distill Llama 3.1 16B
DeepSeek · MaziyarPanahi
Params15.7B
Context128K
Smallest10.8 GB
ReasoningTool use
DE
DeepSeek R1 8B Medical
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 BF16
DeepSeek · gguf
Params480B
Context160K
Q4_K_M293.3 GB
Reasoning
DE
Deepseek Qwen2.5 7B Redistil
DeepSeek · jan-hq
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · wy8edhuh
Params8.19B
Context128K
Smallest4.6 GB
ReasoningTool use
DE
Network Model 8BV3
DeepSeek · guoguovc
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · sleepyeldrazi
Params155B
Context1024K
Smallest55.9 GB
ReasoningTool use
DE
deepseek deepseek r1 distill 14b
DeepSeek · cPilotGod
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
law zhangwei
DeepSeek · whatfa
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · grapevine-AI
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT RV
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Improved Deepseek Qwen 3
DeepSeek · Aadeshisdoingsomething
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 REAM144 163B DS4
DeepSeek · WaveCut
Params163B
Context1024K
Smallest6.0 GB
GGUF

Keep browsing