DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
R1 Q3 X2
DeepSeek · mradermacher
Params10.5B
Context128K
Q4_K_M6.4 GB
ReasoningTool use
DE
DeepSeek V4 Flash imatrix aligned
DeepSeek · jedisct1
Params284B
Context—
Smallest3.8 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V1b count288 IQ2XS
DeepSeek · cliecy
Params613B
Context1024K
Smallest239.9 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA BASE2
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
DE
DeepSeek V4.1 Flash 1017 V6e codezh reap176gen16 IQ2XS
DeepSeek · cliecy
Params477B
Context1024K
Smallest199.2 GB
GGUF
DE
Fathom R1 14B
DeepSeek · quantized4all
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · nsparks
Params284B
Context1024K
Smallest156.1 GB
GGUF
DE
DeepSeek R1 API Doc
DeepSeek · meathuggingface
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B SLERPSOURCE
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
Deepseek Coder 1.3B Kexer
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek R1 English Teacher
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
rinna/deepseek-r1-distill-qwen2.5-bakeneko-32b
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
Huldra R1 8b DEEPSEEK
DeepSeek · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek V4 Flash
DeepSeek · bartowski
Params284B
Context1024K
Smallest156.0 GB
GGUF
DE
Qwen2.5 DeepSeek R1 MFANN Slerp 7b
DeepSeek · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · 39mk39mk
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 iVQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 NVFP4
DeepSeek · axiomofmind
Params—
Context—
Smallest10.9 GB
GGUF
DE
DeepSeek V4 Flash 0731 REAM96 111B DS4
DeepSeek · WaveCut
Params111B
Context1024K
Smallest6.0 GB
GGUF
DE
DeepSeek R1 Medical o1 COT
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Strategy Qwen 2.5 1.5b Unstructured To Structured
DeepSeek · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
ReasoningTool use
DE
Deepseek Ai Deepseek Coder 6.7b Base
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · osllmai-community
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek R1 Llama 8b Gold
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 DepressionAnalysis
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B SLERPSOURCE
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
olmo-3-7b-lean-prover-dpo
DeepSeek · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
DE
SafeWork R1 DeepSeek 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Q4 0
DeepSeek · SamPurkis
Params7.62B
Context128K
Smallest4.4 GB
ReasoningTool use

Keep browsing