DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B GTAP v3 IQ2 M
DeepSeek · DuoNeural
Params1.78B
Context128K
Smallest0.7 GB
ReasoningTool use
DE
LFM2.5 1.2B MEGABRAIN Thinking Polaris ClaudeHOPUS Deepseek GLM
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
DE
DeepSeekR1 QwQ SkyT1 32B Fusion 715
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 14b Medical COT i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
ScaleQuest DeepSeekMath 7B QGen
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · andreaborio
Params2150.4B
Context1024K
Smallest86.7 GB
GGUF
DE
DeepSeek R1 RACE
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · DuoNeural
Params7.62B
Context128K
Smallest3.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Maites
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B unsloth gguf japanese imatrix
DeepSeek · dahara1
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
NaniDAO/deepseek-r1-qwen-2.5-32B-ablated
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
mobiuslabsgmbh.DeepSeek R1 ReDistill Qwen 1.5B v1.0
DeepSeek · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Huldra R1 v2 8b DEEPSEEK i1
DeepSeek · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 32B GuiyangGuian Lora v1.5
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 Maya
DeepSeek · pp111asd
Params748B
Context1024K
Smallest276.6 GB
GGUF
DE
DeepSeek-R1-Distill-Qwen-7B-TIR-o3-mini-code
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
DE
DeepSeek R1 Qwen2.5 1.5b SFT R1 JSON Unstructured To Structured
DeepSeek · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
DE
Polaris-7B-Preview
DeepSeek · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · longlenai-team
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
ahmedheakl asm2asm deepseek 1.3b 100k x86 O0 4ep arm gnueabi gcc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
CoderO1 DeepSeekR1 14B Preview
DeepSeek · RDson
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingTool use
DE
eldoprano/DeepSeek-R1-Distill-Llama-8B-abliterated
DeepSeek · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek coder 7b instruct v1.5f
DeepSeek · aless2212
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · EasierAI
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepScaleR 1.5B Preview
DeepSeek · DhruvalLabs
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
QwQ DeepSeek R1 SkyT1 Flash Lighter 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek-V4-Flash-MXFP4-FP8-BF16
DeepSeek · 6ms
Params284B
Context1024K
Smallest156.1 GB
GGUF
DE
claude Deepseek R1 Qwen3
DeepSeek · mondk
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing