DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek V4 Flash
DeepSeek · Volko76
Params284B
Context1024K
Smallest153.0 GB
DE
deepseek txt to sql
DeepSeek · ujwalreddykotla111
Params8.03B
Context128K
Smallest8.5 GB
DE
fortinet lora
DeepSeek · NOYOUllm2
Params6.91B
Context4K
Smallest4.2 GB
DE
asm2asm deepseek 1.3b 250k x86 O0 arm gnueabi gcc
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
deepseek medical
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · noteventhrice
Params8.19B
Context128K
Smallest8.7 GB
DE
DeepSeek R1 Distill Llama 70B Improved
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · 5fp
Params15.7B
Context160K
Smallest9.5 GB
DE
Fuse DeepSeek R1 32B RL S1 52
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
deepseek r1 llama 8b harmony
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek r1 medical
DeepSeek · fzkun
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest378.4 GB
DE
DeepSeek V4 Flash 0731 UD IQ3 IQ2 XS
DeepSeek · Oxidez
Params284B
Context1024K
Smallest93.0 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · enacimie
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
asm2asm deepseek 1.3b 500k 4ep local x86 O0 arm gnueabi gcc
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
Wayfair Garage
DeepSeek · vivirocks
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 70B NVFP4
DeepSeek · PiehSoft
Params70.6B
Context128K
Smallest42.7 GB
DE
DeepSeek Distill RL 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest0.9 GB
DE
DeepSeek V4 Flash REAP 80G imatrix 0731
DeepSeek · jabbatheduck
Params180B
Context1024K
Smallest70.9 GB
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest8.6 GB
DE
adilet deepseek 8b 27 ollama
DeepSeek · jakcpto
Params8.03B
Context128K
Smallest16.1 GB
DE
karma electric r1distill llama 8b
DeepSeek · anicka
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · Trisert
Params15.7B
Context160K
Smallest8.9 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest4.4 GB
DE
DeepSeek TNG R1T2 Chimera IK
DeepSeek · Kebob
Params671B
Context160K
Smallest365.9 GB
DE
deepseek-coder-1.3b-base
DeepSeek · icycodes
Params1.35B
Context16K
Smallest1.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · Cran-May
Params8.03B
Context128K
Smallest5.7 GB
DE
DeepSeek V2 Lite
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB