DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek R1 Distill Qwen 1.5b Unsloth Bnb 4bit
DeepSeek · Gaaiwing
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · BenevolenceMessiah
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Aldaris
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
Llama 70B DeepSeek R1 Distill
DeepSeek · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · TheGamerNew
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · anemll
Params7.31B
Context1024K
Smallest9.0 GB
GGUF
DE
kubernetes operator 8b deepseek peft
DeepSeek · dereklck
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
deepseekQwen15Test
DeepSeek · Olbyer
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
deepseek r1 8b
DeepSeek · YoungC0320
Params8.03B
Context128K
Smallest4.9 GB
ReasoningTool use
DE
Finance DeepSeek R1 Distill Llama 8B LoRA GGUF Q8 0
DeepSeek · heladell
Params8.03B
Context128K
Smallest8.5 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · recursechat
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek Fashion sims
DeepSeek · heosanghun
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · nguyenthilaitrieulong
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
DE
assist llm
DeepSeek · data-niklas
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · salen-00
Params284B
Context1024K
Smallest102.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill 1.5B Q4 K M
DeepSeek · jc-builds
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · rafw007
Params284B
Context1024K
Smallest86.7 GB
CodingReasoningTool use
DE
Qwen3 4B distill deepseek opus gemini ethical
DeepSeek · ertghiu256
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · ravenside
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek V2 Lite Chat Uncensored Unbiased
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.3 GB
ReasoningTool use
DE
DeepSeek V3.1 HQ4 K
DeepSeek · anikifoss
Params671B
Context160K
Smallest442.5 GB
ReasoningTool use
DE
deepseek-coder-6.7b-base
DeepSeek · icycodes
Params6.74B
Context16K
Smallest7.2 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · matrixportalx
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · Dodgy420
Params14.8B
Context128K
Smallest12.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest18.8 GB
CodingReasoningRoleplay

Keep browsing