DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · AtomicChat
Params115M
Context—
Smallest0.5 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
Qwen3.5 9B Distill Deepseek V4.1 Flash 20261004
DeepSeek · kevinzhou21
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 ELVEZ Q2
DeepSeek · elvezjp
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek V4 Flash Vision Strix Halo
DeepSeek · otheru
Params284B
Context—
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
Deepseek-Prover-V2-7B
DeepSeek · unsloth
Params6.91B
Context32K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · apetersson
Params284B
Context1024K
Smallest102.8 GB
Vision
DE
DeepSeek V2.5
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek V4 Flash 0731
DeepSeek · AtomicChat
Params284B
Context1024K
Smallest70.2 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 REAP 150b TQ3 4S
DeepSeek · Tinker-Stack
Params150B
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · richardyoung
Params8.2B
Context128K
Q4_K_M5.0 GB
Reasoning
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Q4_K_M8.6 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · Melvin56
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
Deepseeker Kunou Qwen2.5 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · AtomicChat
Params552B
Context1024K
Smallest120.7 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 FP8
DeepSeek · AMAImedia
Params748B
Context1024K
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
DE
DeepSeek R1 Qwen3 8B heretic
DeepSeek · saidutta69
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
DE
Qwen3.5 9B Distill Deepseek V4.1 Flash 20261003
DeepSeek · kevinzhou21
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
Coding
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Headroom128
DeepSeek · apetersson
Params284B
Context—
Smallest6.0 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · ox-ox
Params284B
Context1024K
Smallest97.6 GB
GGUF

Keep browsing