DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
DE
Qwen3.5 9B DeepSeek 3.2 Intense Auto Variable Thinking
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
deepseek llm 67b base i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
DE
Andy 4
DeepSeek · Sweaterdog
Params8B
Context128K
Q4_K_M4.9 GB
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · Edmon02
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
Deepseek ai.DeepSeek V3.1 Terminus BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
DE
deepseek-ocr2
DeepSeek · cstr
Params3.39B
Context—
Smallest2.3 GB
DE
DeepSeek R1 Distill Qwen 14B imatrix
DeepSeek · liodon-ai
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek V4 Pro Qwen3.5 9B
DeepSeek · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
DeepScaleR 1.5B Preview
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
tiny random deepseek distill qwen
DeepSeek · sammysun0711
Params514M
Context128K
Smallest0.6 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · jacobcarajo
Params14.8B
Context128K
Smallest10.5 GB
DE
Deepseek LLM 7B Chat
DeepSeek · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · eaddario
Params7.62B
Context128K
Q4_K_M4.2 GB
DE
DeepSeek V3 Bf16
DeepSeek · bullerwins
Params671B
Context160K
Q4_K_M404.4 GB
DE
DeepSeek V4.1 Flash 1017 Volta
DeepSeek · lxe
Params—
Context—
Smallest441.6 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · Thaurock
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
DE
Josiefied DeepSeek R1 0528 Qwen3 8B Abliterated v1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
DE
DeepSeek R1 Distill Qwen 32B Medical i1
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
DE
L3.1 MOE 2X8B Deepseek DeepHermes e32 uncensored abliterated 13.7B i1
DeepSeek · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB