DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek V4 Flash 0731 ream 150b
DeepSeek · puwaer
Params150B
Context1024K
Smallest0.3 GB
DE
DeepSeek R1 Distill Llama UK Legislation 8B
DeepSeek · EryriLabs
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Q4 deepseek ocr ktp
DeepSeek · ronaldhandiwinata
Params891M
Context128K
Q4_K_M0.5 GB
DE
DeepSeek BlackRoot R1 Distill Llama 3.1 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B GTAP v3 IQ3 XXS
DeepSeek · DuoNeural
Params1.78B
Context128K
Smallest0.8 GB
DE
DeepSeek Prover V1
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 FrenchPhilosophy
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
DE
deepseek coder 6.7b pandasai jagr
DeepSeek · octadion
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek-R1-Distill-Llama-3B-tools-SFT
DeepSeek · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
deepseek r1 distill llama 70b topo governed q8 0
DeepSeek · frankmorales2020
Params70.6B
Context128K
Smallest75.0 GB
DE
Openbuddy Deepseek 67b v15 Base
DeepSeek · RichardErkhov
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
Barrier Free Fine Tuning_Deepseek R1 0528 Qwen3 8B_alpaca Gguf
DeepSeek · heseltiNe
Params8.19B
Context128K
Smallest8.7 GB
DE
Quacken R1 14B FP8
DeepSeek · Gorilla4X
Params14.8B
Context128K
Smallest17.2 GB
DE
DeepSeek R1 Distill Qwen 1.5B Medical Msft Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
pragmatic architect 7b
DeepSeek · CODERehanaman
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Deepseek Math 7b Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 Medical COT LORA i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek coder 7b instruct v1.5 qlora amenokaku code
DeepSeek · NightFox
Params6.91B
Context4K
Smallest5.7 GB
DE
DeepSeek R1 ReDistill Qwen 7B v1.1
DeepSeek · Melvin56
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Openbuddy Deepseek 10b v17.1
DeepSeek · tensorblock
Params10.6B
Context4K
Smallest4.1 GB
DE
DeepSeek R1 Distill Llama 8B SafeChain
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek-R1-Distill-Llama-8B-Patient-Descriptions
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · duyntnet
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
xdata finetune deepseek reason test medical
DeepSeek · xdatasi
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
LFM2.5 1.2B Deepseek 3.1 Thinking DISTILL
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
DE
deepseek llm 7b base
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · Fastiraz
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · Sowkwndms
Params8.19B
Context128K
Smallest5.9 GB