DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
deepseek-community/Janus-Pro-1B
DeepSeek · Ericwang
Params1.65B
Context16K
Smallest1.8 GB
Vision
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · todayzhxy
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · ErikFeng
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Medical Continual Pretrain Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
FoCus Deepseek Qwen3 8b
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
story_generation_DeepSeek_8B_SFT
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
DeepSeek V4.1 Flash
DeepSeek · ivp5
Params—
Context—
Smallest23.3 GB
GGUF
DE
Deepseek Ai Deepseek Coder 7b Instruct v1.5
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
Coding
DE
Asm2Asm Deepseek 1.3b 500k 2ep Mac X86 O0 Arm
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
Deepseek Parlay 6.7b
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek V4 Flash IQ2XXS TM64 Q4KAttention v1
DeepSeek · erayyapagci
Params284B
Context1024K
Smallest10.6 GB
GGUF
DE
DeepSeek Coder V2 Lite Base
DeepSeek · prvnsmpth
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
MAA Deepseek Qwen 14B TIES Merged
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS
DeepSeek · DiXuWefff
Params197B
Context—
Smallest110.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest3.8 GB
CodingReasoningRoleplay
DE
DeepSeek V4 Flash 0731
DeepSeek · speakguru
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
deepseek r1 redistill qwen 1.5b v1.1
DeepSeek · neopolita
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Nourish DeepSeek Medical R1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · kirikir13
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Vibration1 RAG Version 2
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek prover v1.5 base
DeepSeek · neopolita
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest26.9 GB
ReasoningTool use
DE
DeepSeek R1 0528 Tiny
DeepSeek · mradermacher
Params810M
Context160K
Q4_K_M0.5 GB
ReasoningTool use
DE
deepseekocr
DeepSeek · zhenglingyun
Params2.93B
Context8K
Smallest1.0 GB
GGUF
DE
Deepseek R1 1.5b Heretic
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Openbuddy Deepseek 67b v15.2
DeepSeek · tensorblock
Params67.4B
Context4K
Smallest25.1 GB
GGUF
DE
Llama 3 LewdPlay evo DeepSeek R1 Distill 8B
DeepSeek · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · osllmai-community
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · ZeroWw
Params8.19B
Context128K
Smallest5.5 GB
ReasoningTool use

Keep browsing