DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest14.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen2.5 1.5B LimaRP Uncensored IQ4 XS
DeepSeek · Novaciano
Params1.78B
Context128K
Smallest1.0 GB
ReasoningTool use
DE
DeepSeek Prover V2 7B
DeepSeek · irmma
Params6.91B
Context64K
Q4_K_M4.2 GB
Tool use
DE
DeepSeek R1 Distill Llama 3.1 16.5B Brainstorm i1 Q3 K S
DeepSeek · roleplaiapp
Params16.5B
Context128K
Smallest7.3 GB
ReasoningTool use
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest26.9 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest289.2 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · RCorvalan
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
DeepSeek R1 Medical COT QWEN2.5
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest14.4 GB
ReasoningTool use
DE
deepseek 15 epoch
DeepSeek · Kei5uke
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
deepseek medical4
DeepSeek · inhacoms
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
deepseek medical2
DeepSeek · baraming
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
deepseek ft
DeepSeek · qw7850400
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
Deepseek_Medical6_E1
DeepSeek · going2005
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Health Risk COT Qwen
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Smallest6.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · Bluerosesbutterfly
Params14.8B
Context128K
Smallest12.1 GB
ReasoningTool use
DE
Qwen2.5 DeepSeek R1 MFANN 7b Q4 K S
DeepSeek · netcat420
Params7.62B
Context4K
Smallest4.5 GB
ReasoningTool use
DE
fortunetelling
DeepSeek · yulintx
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
Deepseek Qwen 14B
DeepSeek · bigspace001
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · PandaTrainer
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · BenevolenceMessiah
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek R1 agriculture New2
DeepSeek · isAsong
Params8.03B
Context128K
Q4_K_M16.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest4.5 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Medical WBC COT Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · snuggguf
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · G17c21ds
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B hqx 20250206
DeepSeek · eebyp
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · kirihato
Params8.03B
Context128K
Smallest6.6 GB
ReasoningTool use

Keep browsing