DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash
DeepSeek · sleepyeldrazi
Params208B
Context1024K
Smallest105.9 GB
ReasoningTool use
DE
deepseek v3.2 512M
DeepSeek · DevJadhav
Params1.34B
Context2K
Smallest1.4 GB
GGUF
DE
DeepSeek R1 ru 8b
DeepSeek · cybertruck32489
Params8.03B
Context128K
Smallest5.7 GB
ReasoningTool use
DE
NiNa deepseek testing
DeepSeek · LockeLamora2077
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
deepseek medical5
DeepSeek · PAUL1122
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
deepseek model
DeepSeek · gegege11
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek IT Support q4 k m v6
DeepSeek · elsonj
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Qwen 1M DeepSeek R1 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Lddn Model Deepseek R1 Distill Llama 8b
DeepSeek · witbar
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
Retsci Retail Tuned llm DeepSeek R1 Distill Qwen 1.5B f16
DeepSeek · AchrafRet
Params1.78B
Context128K
Smallest3.6 GB
ReasoningTool use
DE
DeepSeek R1 1.5B Heretic
DeepSeek · N14QM
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B bnb 4bit zy
DeepSeek · Xiaojiong
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
Qwen2.5 0.5B
DeepSeek · Brianpuz
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
DE
DeepSeek LLM 7B Chat F16
DeepSeek · Asit03
Params6.91B
Context8K
Smallest13.8 GB
GGUF
DE
deepseek tony model
DeepSeek · Tonyjavis
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek math
DeepSeek · lllljff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek-V2-Lite-Chat
DeepSeek · ZeroWw
Params15.7B
Context160K
Smallest12.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B FineTune
DeepSeek · CALISTA-INDUSTRY
Params1.78B
Context128K
Smallest3.6 GB
ReasoningTool use
DE
Qwen2.5 32B DeepSeek R1 Instruct i1 IQ3 XS
DeepSeek · roleplaiapp
Params32.8B
Context32K
Smallest13.7 GB
ReasoningTool use
DE
Finetuned DeepSeek R1 Distill Llama 8B CoT Financial Analyst F16
DeepSeek · geasadfg
Params42M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · adriey
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · SandLogicTechnologies
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat
DeepSeek · pipilok
Params15.7B
Context160K
Smallest8.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · iceqi1979
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · yeyugame
Params7.62B
Context128K
Smallest5.4 GB
CodingReasoningRoleplay
DE
dsv4 flash 0731 iq2xxs
DeepSeek · MimiTechAI
Params284B
Context1024K
Smallest86.6 GB
ReasoningTool use
DE
DeepSeek R1 Power 1.5B
DeepSeek · wan202101
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 4bit sql model
DeepSeek · jackcwf
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT ReasoningV2
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
netlist deepseek r1 80L
DeepSeek · perkros
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use

Keep browsing