DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
deepseek opt merged 1.3b
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
DE
deepseek coder 6.7b instruct
DeepSeek · aless2212
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rbinrs
Params284B
Context1024K
Smallest3.8 GB
GGUF
DE
DeepSeek Prover V2 7B
DeepSeek · mradermacher
Params6.91B
Context64K
Q4_K_M4.2 GB
Tool use
DE
DeepSeek R1 0528 Qwen3 8B Abliterated
DeepSeek · Notenufftime
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 dsx 3.0bit
DeepSeek · icecubetr
Params552B
Context—
Smallest213.6 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · MedAmineMahmoud
Params115M
Context—
Smallest0.5 GB
GGUF
DE
DeepSeek V3 0324
DeepSeek · lmstudio-community
Params671B
Context160K
Q4_K_M404.4 GB
Tool use
DE
DeepSeek R1 1.5B Medical COT i1
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek-V4-Flash-0731-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
GGUF
DE
DeepSeek V2.5 1210
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
Tool use
DE
Srijith rkr deepseek base 1e 4 NO cot only speed samples 10 epoch
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Srijith rkr deepseek base 1e 3 NO cot all samples 100 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
deepseek1.5B Medical Finetune
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 Q2 dense q4 imx cliecy
DeepSeek · aaa2015
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · chatseeon
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
DE
DeepSeek-V4.1-Flash-1017 Artemis
DeepSeek · turintech
Params748B
Context1024K
Smallest330.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Unsloth Bnb 4bit
DeepSeek · chinmay1718
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Qwen2.5 7B DeepSeek R1 1M
DeepSeek · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Wanda Structured 2 4
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · DuoNeural
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · gaianet
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
deepseek coder 6.7b pandas
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeekMath Base SFT
DeepSeek · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
DE
Deepseek Llm 7b Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B GuiyangGuian Lora v1.5
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning

Keep browsing