DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
GGUF
DE
Qwen3.5 9B DeepSeek 3.2 Intense Auto Variable Thinking
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
DE
deepseek llm 67b base i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
DE
Andy 4
DeepSeek · Sweaterdog
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · Edmon02
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
Deepseek ai.DeepSeek V3.1 Terminus BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
GGUF
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
Coding
DE
deepseek-ocr2
DeepSeek · cstr
Params3.39B
Context—
Smallest2.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B imatrix
DeepSeek · liodon-ai
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek V4 Pro Qwen3.5 9B
DeepSeek · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
DE
DeepScaleR 1.5B Preview
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
tiny random deepseek distill qwen
DeepSeek · sammysun0711
Params514M
Context128K
Smallest0.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · jacobcarajo
Params14.8B
Context128K
Smallest10.5 GB
ReasoningTool use
DE
Deepseek LLM 7B Chat
DeepSeek · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · eaddario
Params7.62B
Context128K
Q4_K_M4.2 GB
Reasoning
DE
DeepSeek V3 Bf16
DeepSeek · bullerwins
Params671B
Context160K
Q4_K_M404.4 GB
Tool use
DE
DeepSeek V4.1 Flash 1017 Volta
DeepSeek · lxe
Params—
Context—
Smallest441.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · Thaurock
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
Vision
DE
Josiefied DeepSeek R1 0528 Qwen3 8B Abliterated v1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
DE
Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
CodingReasoning
DE
DeepSeek R1 Distill Qwen 32B Medical i1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
L3.1 MOE 2X8B Deepseek DeepHermes e32 uncensored abliterated 13.7B i1
DeepSeek · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
ReasoningTool use
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding

Keep browsing