DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek V2 Lite Chat
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Smallest14.1 GB
DE
DeepSeek R1 Distill Qwen2.5 1.5B LimaRP Uncensored IQ4 XS
DeepSeek · Novaciano
Params1.78B
Context128K
Smallest1.0 GB
DE
DeepSeek Prover V2 7B
DeepSeek · irmma
Params6.91B
Context64K
Q4_K_M4.2 GB
DE
DeepSeek R1 Distill Llama 3.1 16.5B Brainstorm i1 Q3 K S
DeepSeek · roleplaiapp
Params16.5B
Context128K
Smallest7.3 GB
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest26.9 GB
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest289.2 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · RCorvalan
Params14.8B
Context128K
Smallest5.8 GB
DE
DeepSeek R1 Medical COT QWEN2.5
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest14.4 GB
DE
deepseek 15 epoch
DeepSeek · Kei5uke
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
deepseek medical4
DeepSeek · inhacoms
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
deepseek medical2
DeepSeek · baraming
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek ft
DeepSeek · qw7850400
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Deepseek_Medical6_E1
DeepSeek · going2005
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Health Risk COT Qwen
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Smallest6.6 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · Bluerosesbutterfly
Params14.8B
Context128K
Smallest12.1 GB
DE
Qwen2.5 DeepSeek R1 MFANN 7b Q4 K S
DeepSeek · netcat420
Params7.62B
Context4K
Smallest4.5 GB
DE
fortunetelling
DeepSeek · yulintx
Params8.03B
Context128K
Smallest8.5 GB
DE
Deepseek Qwen 14B
DeepSeek · bigspace001
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · PandaTrainer
Params14.8B
Context128K
Smallest10.3 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · BenevolenceMessiah
Params14.8B
Context128K
Smallest15.7 GB
DE
DeepSeek R1 agriculture New2
DeepSeek · isAsong
Params8.03B
Context128K
Q4_K_M16.1 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest4.5 GB
DE
DeepSeek R1 Medical WBC COT Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · snuggguf
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · G17c21ds
Params32.8B
Context128K
Smallest34.8 GB
DE
DeepSeek R1 Distill Qwen 7B hqx 20250206
DeepSeek · eebyp
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · kirihato
Params8.03B
Context128K
Smallest6.6 GB