DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
KSU HW SEC Deepseek SFT RL Text DFG AST
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DE
deepseek ai deepseek math 7b rl
DeepSeek · tastypear
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V2.5
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
CodingTool use
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · squ0sh
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeekR1 QwQ SkyT1 32B Fusion 622
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 UNCENSORED MTP Maya Q4 K IQ4
DeepSeek · Adolphsson
Params485M
Context—
Smallest471.6 GB
GGUF
DE
Deepseek Llm 7b Chat
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · DhruvalLabs
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek Llm 7b Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
EVE 27b XENO HAT DeepSeek V4 Flash
DeepSeek · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B ORPO Uncensored i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V3 DRAFT 0.6B v3.0
DeepSeek · mradermacher
Params590M
Context32K
Q4_K_M0.5 GB
GGUF
DE
Nemotron Orchestrator 8B DeepSeek v3.2 Speciale Distill
DeepSeek · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT ppt
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 32b Medical COT
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
AIFT-NCM-DeepSeek-1.41B-SFT
DeepSeek · binxx71
Params1.41B
Context—
Smallest5.6 GB
GGUF
DE
Deepseek NSFW Qwen3
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · Human23
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
Llama 3.1 8B DeepSeek67B Distilled
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · ct-2
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 ComputerScience COT Qwen 7B FineTuned
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · dpmg42
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
DeepSeek V4 Flash
DeepSeek · ssweens
Params284B
Context1024K
Smallest67.5 GB
ReasoningTool use
DE
Deepseek Moe 16b Base
DeepSeek · mradermacher
Params16.4B
Context4K
Q4_K_M10.9 GB
GGUF
DE
ahmedheakl asm2asm deepseek 1.3b 100k float16 attn
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
LFM2.5 1.2B Deepseek 3.1 Thinking DISTILL
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
DE
Srijith rkr deepseek base 1e 4 NO cot only failed samples 300 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 0528 CODER DRAFT 0.6B
DeepSeek · mradermacher
Params590M
Context160K
Q4_K_M0.5 GB
CodingReasoningTool use
DE
deepseek-coder-6.7b-instruct
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing