DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
lumynax coder deepseek v2 lite 16b
DeepSeek · AbteeXAILab
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
Deepseek Coder 1.3b Base
DeepSeek · ShayonSarker
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
DeepSeek V4.1 Flash
DeepSeek · bigfat
Params755B
Context—
Smallest365.7 GB
GGUF
DE
DeepSeek V4 Pro 0813
DeepSeek · ryant0000
Params1570B
Context1024K
Smallest222.2 GB
GGUF
DE
Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Deepseek ai.DeepSeek R1 Distill Qwen 14B
DeepSeek · DevQuasar-7
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · gaianet
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B Esper3
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
CodingReasoningTool use
DE
Deepseek v4 Distill Qwen3 1.7b
DeepSeek · ertghiu256
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · quantized4all
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
Athena Llamamerge 70B
DeepSeek · mradermacher
Params69.7B
Context128K
Q4_K_M41.9 GB
Tool use
DE
DeepSeek V3 7B Drama Script Review
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Mlx Community DeepSeek R1 Distill Qwen 14B
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · pandabearxo29
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen deepseek 14B i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DE
DSV4 Flash Vision Exp ablit DS4
DeepSeek · dicksondickson
Params466M
Context—
Smallest0.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated MXFP4
DeepSeek · daemonix
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
ReasoningTool use
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
ds41 sidecars
DeepSeek · staccs
Params—
Context1024K
Smallest0.0 GB
Vision
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · brittlewis12
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B imatrix
DeepSeek · liodon-ai
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 obliterated upstream
DeepSeek · HumanjavaEnterprises
Params748B
Context1024K
Smallest1.6 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · 0xSero
Params163B
Context1024K
Smallest75.0 GB
ReasoningTool use
DE
DeepSeek R1 Pruned 50B
DeepSeek · mradermacher
Params49.6B
Context160K
Q4_K_M30.2 GB
ReasoningTool use
DE
tngtech.DeepSeek R1T Chimera Bf16
DeepSeek · DevQuasar-14
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use

Keep browsing