DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
autotrain h21ao zct4v
DeepSeek · islamytchaev
Params7.61B
Context128K
Smallest8.1 GB
DE
deepseek coder 7b instruct
DeepSeek · jtrancas
Params6.74B
Context16K
Smallest2.8 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Hydraulic Deepseek 16bit V2
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Model Deepseek Ai DeepSeek R1 Distill Qwen 1.5B Cache
DeepSeek · Alcoft
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V2.5
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
DE
Qwen3 30B A3B Thinking 2507 Deepseek v3.1 Distill FP32
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
DeepSeek R1 ReDistill Qwen 7B v1.1 i1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
deepseek coder 6.7b instruct pythagora v3
DeepSeek · LoupGarou
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
neoAI JP DeepSeek Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
Deepseek_Ai_Deepseek_Coder_V2_Lite_Instruct Nl2Sqlpp 16bit v4.0 Cw 4K
DeepSeek · lainlives
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Medical WBC COT Qwen 7B i1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B abliterated
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V3 0324 CODER DRAFT 0.6B v1.1
DeepSeek · mradermacher
Params590M
Context64K
Q4_K_M0.5 GB
DE
Mixtral 8x7B DeepSeek R1 Distill
DeepSeek · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
DE
deepseek-coder-1.3b-chat
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
Deepseek ai.DeepSeek R1 Distill Qwen 7B
DeepSeek · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek Coder V2 Lite Base
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
Deepseek qwen modelstock 2B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek GRM 16B
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek V2 Grand Horror SMB R1 Distill Llama 3.1 Uncensored 16.5B
DeepSeek · mradermacher
Params16.5B
Context128K
Q4_K_M10.0 GB
DE
ahmedheakl asm2asm deepseek 1.3b 500k x86 O0 arm gnueabi gcc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
CodeFuse DeepSeek 33B
DeepSeek · LoneStriker
Params33.3B
Context16K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · matrixportalx
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
L3.1 MOE 2X8B Deepseek DeepHermes e32 13.7B i1
DeepSeek · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Qwen2.5 1.5b SFT R1 JSON Unstructured To Structured i1
DeepSeek · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
DE
Llama 3.1 DeepSeek 8B DarkIdol Instruct 1.2 Uncensored
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB