DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash 0731 ream 150b
DeepSeek · puwaer
Params150B
Context1024K
Smallest0.3 GB
GGUF
DE
DeepSeek R1 Distill Llama UK Legislation 8B
DeepSeek · EryriLabs
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Q4 deepseek ocr ktp
DeepSeek · ronaldhandiwinata
Params891M
Context128K
Q4_K_M0.5 GB
ReasoningTool useVision
DE
DeepSeek BlackRoot R1 Distill Llama 3.1 8B i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B GTAP v3 IQ3 XXS
DeepSeek · DuoNeural
Params1.78B
Context128K
Smallest0.8 GB
ReasoningTool use
DE
DeepSeek Prover V1
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 FrenchPhilosophy
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
ReasoningTool use
DE
deepseek coder 6.7b pandasai jagr
DeepSeek · octadion
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek-R1-Distill-Llama-3B-tools-SFT
DeepSeek · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
deepseek r1 distill llama 70b topo governed q8 0
DeepSeek · frankmorales2020
Params70.6B
Context128K
Smallest75.0 GB
ReasoningTool use
DE
Openbuddy Deepseek 67b v15 Base
DeepSeek · RichardErkhov
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
DE
Barrier Free Fine Tuning_Deepseek R1 0528 Qwen3 8B_alpaca Gguf
DeepSeek · heseltiNe
Params8.19B
Context128K
Smallest8.7 GB
ReasoningTool use
DE
Quacken R1 14B FP8
DeepSeek · Gorilla4X
Params14.8B
Context128K
Smallest17.2 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Medical Msft Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
pragmatic architect 7b
DeepSeek · CODERehanaman
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
DE
Deepseek Math 7b Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Medical COT LORA i1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek coder 7b instruct v1.5 qlora amenokaku code
DeepSeek · NightFox
Params6.91B
Context4K
Smallest5.7 GB
Coding
DE
DeepSeek R1 ReDistill Qwen 7B v1.1
DeepSeek · Melvin56
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
Openbuddy Deepseek 10b v17.1
DeepSeek · tensorblock
Params10.6B
Context4K
Smallest4.1 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B SafeChain
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
DE
DeepSeek-R1-Distill-Llama-8B-Patient-Descriptions
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · duyntnet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
DE
xdata finetune deepseek reason test medical
DeepSeek · xdatasi
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
LFM2.5 1.2B Deepseek 3.1 Thinking DISTILL
DeepSeek · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
DE
deepseek llm 7b base
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · Fastiraz
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · Sowkwndms
Params8.19B
Context128K
Smallest5.9 GB
ReasoningTool use

Keep browsing