DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 CyberSecurity CHMP AS GGUF V1
DeepSeek · GigoFof
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest15.9 GB
DE
DeepSeek R1 Distill Llama 8B Unsloth Bnb 4bit
DeepSeek · rwibawa
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · doufunao123
Params14.8B
Context128K
Smallest10.5 GB
DE
DeepSeekR1 QwQ SkyT1 32B Fusion 811
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Quasar DeepSeek R1 Distill Qwen 14B TTM
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek Coder V2 Lite Base
DeepSeek · phi0112358
Params15.7B
Context160K
Smallest9.5 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest57.9 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · pipilok
Params15.7B
Context160K
Smallest8.9 GB
DE
DeepSeek R1 Medical COT 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Qwen 14B abliterated v2
DeepSeek · TenTour
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Llama 8B Abliterated Q4 0
DeepSeek · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
DE
DeepSeek V2 Lite Chat Uncensored Unbiased Reasoner
DeepSeek · NexesQuants
Params15.7B
Context4K
Smallest16.7 GB
DE
DeepSeek V4 Flash
DeepSeek · eouya2
Params220B
Context1024K
Smallest68.6 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest26.4 GB
DE
RTLCoder Deepseek OB50
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · tatsuyaaaaaaa
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · kirihato
Params8.03B
Context128K
Smallest5.7 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params5376B
Context160K
Smallest442.1 GB
DE
deepseek coder v2 lite reap q4q3
DeepSeek · S4ntyC1t
Params12.1B
Context160K
Smallest6.0 GB
DE
DeepSeek R1 Distill Qwen 7B GRPO v7 1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V2 Lite Chat Uncensored Unbiased Reasoner
DeepSeek · ijohn07
Params15.7B
Context4K
Q4_K_M10.4 GB
DE
DeepSeek R1 Health Risk COT3
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek r1 medicalQA Llama3
DeepSeek · boazchung
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · phenixstar
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
asm2asm-deepseek-1.3b-500k-mac-x86-O0-arm-2
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
fortunetelling
DeepSeek · u2mithrandir
Params8.03B
Context128K
Smallest8.5 GB
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest10.5 GB
DE
th reasoning 03 deepseek1.5b GRPO
DeepSeek · RJTPP
Params1.78B
Context128K
Q4_K_M1.1 GB