DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash 1017 Abliteration LoRA
DeepSeek · BoldingBuilds
Params115M
Context—
Smallest0.5 GB
GGUF
DE
deepseek r1 distill qwen 1 5b q4 k m llamacpp vivo x300
DeepSeek · Arm
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek-V2-Chat-0628
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · 1bit-MONSTER
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek OCR 2
DeepSeek · SandLogicTechnologies
Params2.93B
Context8K
Smallest1.4 GB
GGUF
DE
GenBook Deepseek R1.Llama 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4 Flash Vision Uncensored
DeepSeek · orcarouter
Params284B
Context1024K
Smallest156.4 GB
ReasoningTool useVision
DE
Llama 3.3 70b DeepSeek R1 Dropable V1.01 i1
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
Qwen3.5 13B GLM 4.7 Flash DeepSeek Polaris Grande Deep Thinking
DeepSeek · firedancer
Params12.4B
Context256K
Q4_K_M7.7 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 25.5B Brainstorm
DeepSeek · mradermacher
Params25.5B
Context128K
Q4_K_M15.4 GB
ReasoningTool use
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated Censored 19B i1
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
ReasoningTool use
DE
Deepseek R1 Distill Qwen 32b Uncensored
DeepSeek · kainecorneko
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
RPT DeepSeek R1 0528 Qwen3 8B i1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Qwen3 8B Abliterated
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V2 Chat 0628
DeepSeek · bullerwins
Params236B
Context160K
Q4_K_M142.5 GB
GGUF
DE
deepseek-coder-33b-instruct
DeepSeek · RichardErkhov
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
DeepSeek R1 Distill Llama 8B BE
DeepSeek · taronaeo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B 3MPER0RR Training Dna V1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash Base
DeepSeek · ReingeFallen
Params284B
Context1024K
Q4_K_M171.8 GB
GGUF
DE
DeepSeek R1 Medical C0T Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek Coder 7b Base v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
DeepSeek R1 Distill Qwen 14B Uncensored Reasoner
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Nethack
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek llama3.1 HARI 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
deepseek v41 flash 1017 abliterated gguf public
DeepSeek · ktobik
Params748B
Context1024K
Smallest1.6 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · brittlewis12
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V3.1 Nex N1
DeepSeek · mradermacher
Params671B
Context128K
Q4_K_M404.5 GB
Tool use
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Deep Thinker Uncensored 24B i1
DeepSeek · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningTool use

Keep browsing