DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Qwen2.5 1.5b SFT R1 JSON Unstructured To Structured
DeepSeek · MasterControlAIML
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · second-state
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B KAYLA BASE3
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
deepseek math 7b rl
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Gemma 3 12b It Vl Deepseek v3.1 Heretic Uncensored Thinking
DeepSeek · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
DE
DeepSeek-R1-Distill-Qwen-7B-GSPO-Basic
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek OCR 2
DeepSeek · JamePeng2023
Params2.93B
Context8K
Smallest3.1 GB
GGUF
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · XythicK
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · cstr
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
RoguePlanet DeepSeek R1 Qwen 32B RP
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
ReasoningRoleplay
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
ReasoningTool use
DE
DeepSeek R1 Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
DE
Total04 DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen2.5 MOE 2X1.5B DeepSeek Uncensored Censored 4B i1
DeepSeek · mradermacher
Params4.09B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · ggml-org
Params1.78B
Context128K
Smallest1.1 GB
Reasoning
DE
DeepCoder-14B-Preview
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
CodingReasoningTool use
DE
deepseek r1 14b
DeepSeek · PsiPi
Params14.8B
Context128K
Smallest9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · data-pioneer-0826
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · jackklki990
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · second-state
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Hermes
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Desyced
DeepSeek · ApolloRaines
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · ufydy937
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Janus Pro 1B
DeepSeek · Websitedeveloper
Params1.65B
Context16K
Q4_K_M1.0 GB
Vision
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · therickcain
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · MorinoNushi
Params—
Context—
Smallest0.0 GB
GGUF

Keep browsing