DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 1.5B Medical Sft Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
FineTuned DeepSeek R1 Distill Llama 8 CrewAi Docs unsloth
DeepSeek · chinmay1718
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Qwen 14B StackVM
DeepSeek · ianthereal-z
Params14.8B
Context128K
Smallest29.5 GB
ReasoningTool use
DE
UncensoredLM DeepSeek R1 Distill Qwen 14B Q4 K M
DeepSeek · Lucy-in-the-Sky
Params14.2B
Context128K
Q4_K_M8.6 GB
ReasoningTool use
DE
DeepSeek R1 Qwen 7B StackVM
DeepSeek · ianthereal-z
Params7.62B
Context128K
Smallest15.2 GB
ReasoningTool use
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat
DeepSeek · phi0112358
Params15.7B
Context160K
Smallest8.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest30.9 GB
CodingReasoningRoleplay
DE
BoT DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
finetuned deepseek r1 8b QA SILO
DeepSeek · YoojongChoi
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepArch v0.2 1.5B
DeepSeek · DeepArch
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params5376B
Context160K
Smallest184.7 GB
Reasoning
DE
deepseekmath 7b sft GSM8K
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest1.5 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · RileyML1st
Params14.8B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
Deepseek Llm 7b Chat
DeepSeek · Morgen0052
Params6.91B
Context4K
Smallest4.0 GB
GGUF
DE
deepseek14Bmedical model
DeepSeek · sunpanpan1982
Params14.8B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
DeepSeek-V4-Flash-0731-ROCMFPX
DeepSeek · Geometric-AI
Params284B
Context1024K
Smallest102.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · grapevine-AI
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
deepseek medical4
DeepSeek · erpsarang
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
deepseek r1 uncertainty
DeepSeek · leonvanbokhorst
Params7.62B
Context128K
Smallest5.4 GB
ReasoningTool use
DE
moneycontrol deepseek r1
DeepSeek · Akshay2tomar
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
qwen 3 reasoning combination with deepseek
DeepSeek · ertghiu256
Params4.02B
Context40K
Q4_K_M2.5 GB
Reasoning
DE
deepseek r1 medicalQA Qwen
DeepSeek · boazchung
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
llama3.1 deepseek r1 medical merged 16bit
DeepSeek · alaabh
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Medical COT Qwen 1.5B q4 k m
DeepSeek · itachi3939
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
kefuceshi
DeepSeek · z942588879
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek LLM 7B Chat Q4_K_M
DeepSeek · Asit03
Params6.91B
Context8K
Q4_K_M4.2 GB
GGUF

Keep browsing