DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
deepseek opt merged 1.3b
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
deepseek coder 6.7b instruct
DeepSeek · aless2212
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rbinrs
Params284B
Context1024K
Smallest3.8 GB
DE
DeepSeek Prover V2 7B
DeepSeek · mradermacher
Params6.91B
Context64K
Q4_K_M4.2 GB
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · Notenufftime
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek V4.1 Flash 1017 dsx 3.0bit
DeepSeek · icecubetr
Params552B
Context—
Smallest213.6 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · MedAmineMahmoud
Params115M
Context—
Smallest0.5 GB
DE
DeepSeek V3 0324
DeepSeek · lmstudio-community
Params671B
Context160K
Q4_K_M404.4 GB
DE
DeepSeek R1 1.5B Medical COT i1
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek-V4-Flash-0731-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
DE
DeepSeek V2.5 1210
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
DE
Srijith rkr deepseek base 1e 4 NO cot only speed samples 10 epoch
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Srijith rkr deepseek base 1e 3 NO cot all samples 100 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
deepseek1.5B Medical Finetune
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4.1 Flash 1017 Q2 dense q4 imx cliecy
DeepSeek · aaa2015
Params485M
Context—
Smallest1.0 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · chatseeon
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
DE
DeepSeek-V4.1-Flash-1017 Artemis
DeepSeek · turintech
Params748B
Context1024K
Smallest330.4 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B Unsloth Bnb 4bit
DeepSeek · chinmay1718
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Qwen2.5 7B DeepSeek R1 1M
DeepSeek · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 32B Wanda Structured 2 4
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · DuoNeural
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · gaianet
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
deepseek coder 6.7b pandas
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeekMath Base SFT
DeepSeek · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
DE
Deepseek Llm 7b Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 Distill Qwen 32B GuiyangGuian Lora v1.5
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB