DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
deepseek-community/Janus-Pro-1B
DeepSeek · Ericwang
Params1.65B
Context16K
Smallest1.8 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · todayzhxy
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · ErikFeng
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B Medical Continual Pretrain Merged
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
FoCus Deepseek Qwen3 8b
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
story_generation_DeepSeek_8B_SFT
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek V4.1 Flash
DeepSeek · ivp5
Params—
Context—
Smallest23.3 GB
DE
Deepseek Ai Deepseek Coder 7b Instruct v1.5
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
DE
Asm2Asm Deepseek 1.3b 500k 2ep Mac X86 O0 Arm
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
Deepseek Parlay 6.7b
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek V4 Flash IQ2XXS TM64 Q4KAttention v1
DeepSeek · erayyapagci
Params284B
Context1024K
Smallest10.6 GB
DE
DeepSeek Coder V2 Lite Base
DeepSeek · prvnsmpth
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
MAA Deepseek Qwen 14B TIES Merged
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS
DeepSeek · DiXuWefff
Params197B
Context—
Smallest110.6 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest3.8 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · speakguru
Params284B
Context1024K
Smallest10.9 GB
DE
deepseek r1 redistill qwen 1.5b v1.1
DeepSeek · neopolita
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Nourish DeepSeek Medical R1
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · kirikir13
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek R1 Vibration1 RAG Version 2
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek prover v1.5 base
DeepSeek · neopolita
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest26.9 GB
DE
DeepSeek R1 0528 Tiny
DeepSeek · mradermacher
Params810M
Context160K
Q4_K_M0.5 GB
DE
deepseekocr
DeepSeek · zhenglingyun
Params2.93B
Context8K
Smallest1.0 GB
DE
Deepseek R1 1.5b Heretic
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Openbuddy Deepseek 67b v15.2
DeepSeek · tensorblock
Params67.4B
Context4K
Smallest25.1 GB
DE
Llama 3 LewdPlay evo DeepSeek R1 Distill 8B
DeepSeek · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · osllmai-community
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · ZeroWw
Params8.19B
Context128K
Smallest5.5 GB