DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
Qwen3 4B distill deepseek opus gemini
DeepSeek · ertghiu256
Params4.02B
Context40K
Q4_K_M2.5 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · Jianping746
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params16M
Context128K
Smallest0.0 GB
DE
DeepSeekFakeNews LLM 7B Chat
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Qwen2.5 32B
DeepSeek · DevQuasar-3
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 32B Blunt Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek V4.1 Flash RANMA Engram
DeepSeek · SaturnHeaven
Params197B
Context—
Smallest202.8 GB
DE
DeepSeek V4 Flash 0731 ROCmFP3 MIX
DeepSeek · Geometric-AI
Params284B
Context1024K
Smallest98.3 GB
DE
tiny_deepseek_v3_2.5B_0.4B
DeepSeek · mradermacher
Params2.49B
Context4K
Q4_K_M1.5 GB
DE
DeepSeek V4 Flash
DeepSeek · philpax
Params7.67B
Context1024K
Smallest5.9 GB
DE
DeepSeek V4 Flash Base Q4KExperts
DeepSeek · teto3
Params284B
Context1024K
Smallest164.6 GB
DE
DeepSeek R1 Medical Distill Llama 8B
DeepSeek · zeewin-ai
Params8.03B
Context128K
Smallest8.5 GB
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash Japanese ABEJA 32B Preview
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
GRAG Mobius DeepSeek R1 ReDistill LLAMA 8B v1.1 SFT DE
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek v4 flash 0731
DeepSeek · sm54
Params284B
Context1024K
Smallest6.0 GB
DE
Janus Pro 1B
DeepSeek · SkyContact
Params1.96B
Context—
Smallest1.1 GB
DE
DeepSeek Qwen7B CyberSecurity
DeepSeek · safe049
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash IQ3 S
DeepSeek · pinklily69
Params284B
Context1024K
Smallest122.7 GB
DE
DeepSeek V4 Flash
DeepSeek · eouya2
Params155B
Context1024K
Smallest50.4 GB
DE
DeepSeek Grand Horror SMB R1 Distill Llama 3.1 16B
DeepSeek · mradermacher
Params15.7B
Context128K
Q4_K_M9.5 GB
DE
DeepSeek R1 Distill Qwen Fortune 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
PA stage2 DeepSeekQwen 7B 400
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · arhamania
Params15.7B
Context160K
Smallest16.7 GB
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
DE
suzume llama 3 8B japanese
DeepSeek · tatsuyaaaaaaa
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek V4.1 Flash
DeepSeek · ayourtch
Params755B
Context—
Smallest365.7 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · RetroSteve0
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · recursechat
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek-R1-DRAFT-Qwen2.5-0.5B
DeepSeek · alamios
Params494M
Context32K
Q4_K_M0.4 GB
DE
S3 CoT DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB