DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash
DeepSeek · Volko76
Params284B
Context1024K
Smallest153.0 GB
ReasoningTool use
DE
deepseek txt to sql
DeepSeek · ujwalreddykotla111
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
fortinet lora
DeepSeek · NOYOUllm2
Params6.91B
Context4K
Smallest4.2 GB
Reasoning
DE
asm2asm deepseek 1.3b 250k x86 O0 arm gnueabi gcc
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
deepseek medical
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · noteventhrice
Params8.19B
Context128K
Smallest8.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Improved
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · 5fp
Params15.7B
Context160K
Smallest9.5 GB
Coding
DE
Fuse DeepSeek R1 32B RL S1 52
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
deepseek r1 llama 8b harmony
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
deepseek r1 medical
DeepSeek · fzkun
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest378.4 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 UD IQ3 IQ2 XS
DeepSeek · Oxidez
Params284B
Context1024K
Smallest93.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · enacimie
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
asm2asm deepseek 1.3b 500k 4ep local x86 O0 arm gnueabi gcc
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
DE
Wayfair Garage
DeepSeek · vivirocks
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B NVFP4
DeepSeek · PiehSoft
Params70.6B
Context128K
Smallest42.7 GB
ReasoningTool use
DE
DeepSeek Distill RL 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest0.9 GB
CodingReasoningRoleplay
DE
DeepSeek V4 Flash REAP 80G imatrix 0731
DeepSeek · jabbatheduck
Params180B
Context1024K
Smallest70.9 GB
GGUF
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest8.6 GB
ReasoningTool use
DE
adilet deepseek 8b 27 ollama
DeepSeek · jakcpto
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
DE
karma electric r1distill llama 8b
DeepSeek · anicka
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · Trisert
Params15.7B
Context160K
Smallest8.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest4.4 GB
CodingReasoningRoleplay
DE
DeepSeek TNG R1T2 Chimera IK
DeepSeek · Kebob
Params671B
Context160K
Smallest365.9 GB
Tool use
DE
deepseek-coder-1.3b-base
DeepSeek · icycodes
Params1.35B
Context16K
Smallest1.4 GB
Coding
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · Cran-May
Params8.03B
Context128K
Smallest5.7 GB
ReasoningTool use
DE
DeepSeek V2 Lite
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
GGUF

Keep browsing