DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
AStar Thought DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Deepseek ai.DeepSeek R1 0528 Qwen3 8B
DeepSeek · DevQuasar
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeekMath Base SFT Step DPO
DeepSeek · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · wtj111tz
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B Medical Continual Pretrain Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Llama 8B 3MPER0RR abliterated Q8 0
DeepSeek · 3MPER0RR
Params8.03B
Context128K
Smallest8.5 GB
DE
Huihui ai.DeepSeekR1 QwQ SkyT1 32B Fusion 715
DeepSeek · DevQuasar-5
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
mango deepseek41 dspark q8
DeepSeek · isilicon
Params14.2B
Context1024K
Smallest8.0 GB
DE
Deepseek
DeepSeek · nisten
Params236B
Context160K
Smallest62.7 GB
DE
DeepSeek V4 Flash 0731 DSpark
DeepSeek · singulared
Params19.8B
Context1024K
Smallest8.4 GB
DE
DeepSeek V3 0324 DRAFT 0.5B
DeepSeek · mradermacher
Params501M
Context160K
Q4_K_M0.3 GB
DE
GenBook Deepseek R1.Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · qwp4w3hyb
Params236B
Context160K
Smallest47.4 GB
DE
DeepSeek R1 Casino COT
DeepSeek · Smokeydk7
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek V4 Flash 0731 Ornstein
DeepSeek · GestaltLabs
Params284B
Context1024K
Q4_K_M163.6 GB
DE
Qwen3 14B DSpark
DeepSeek · Anbeeld
Params2.64B
Context40K
Q4_K_M1.7 GB
DE
CoderO1 DeepSeekR1 14B Preview
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
Qwen2.5 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mmnga
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Qwen3 30B A3B Thinking Deepseek Distill 2507 v3.1 V2
DeepSeek · rodrigomt
Params30.5B
Context256K
Smallest13.8 GB
DE
DeepSeek Prover V1.5 Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek V4.1 Flash 1017 abliterated cyber GLP 39 L1 39 a0.75
DeepSeek · msuiche
Params—
Context—
Smallest0.0 GB
DE
deepSeek R1 Fine Tuned Medical
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Deepseek R1 Distill NSFW RP vRedux Proper i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Medical COT LORA
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
ahmedheakl asm2asm deepseek 1.3b 100k x86 arm O2
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB