DeepSeek GGUF models

4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DE
Mi Empresa Chatbot Deepseek
DeepSeek · MartinVerastegui
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.4 GB
ReasoningTool use
DE
Deepseek Math 7b Base
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Lucy-in-the-Sky
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
DE
Deepseek Nietzsche
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Brianpuz
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
Deepseek
DeepSeek · nannan1989
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest1.9 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 1.5B uncensored Q8 0
DeepSeek · ghostoverflow
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DE
deepseekR1 7B ruozhiba
DeepSeek · zhangmaoyang
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
Deepseek Llm 7b Chat
DeepSeek · professorf
Params1.18B
Context4K
Smallest1.3 GB
GGUF
DE
deepseek medical4
DeepSeek · TreeOfLife
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
deepseek patent
DeepSeek · xqdaoren
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · CrazyDrag0n
Params15.7B
Context160K
Smallest16.7 GB
Coding
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest169.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params5376B
Context160K
Smallest200.1 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · kirihato
Params7.62B
Context128K
Smallest5.4 GB
ReasoningTool use
DE
Deepseek Llm 7b Base
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V2 Lite Chat
DeepSeek · kkioikk
Params15.7B
Context160K
Smallest11.9 GB
GGUF
DE
DeepSeek R1 0528
DeepSeek · Thireus
Params672B
Context160K
Smallest378.4 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · finetuningrag
Params1.78B
Context128K
Smallest1.9 GB
Reasoning
DE
DeepSeek V4 Flash
DeepSeek · lghupan
Params284B
Context1024K
Smallest86.7 GB
ReasoningTool use
DE
DeepSeek V2 Lite
DeepSeek · Lucy-in-the-Sky
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
DE
deepseek r1 distill qwen 7B math q4 200 prompt chinese
DeepSeek · Croaker3
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
DE
DeepSeek R1 Fine Tuned_V3 PCB_ajuste_model_type
DeepSeek · aurelio0rs1araujo
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 miao 2
DeepSeek · isAsong
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest22.6 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Medical COT Llama 1
DeepSeek · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · enacimie
Params8.19B
Context128K
Smallest6.6 GB
ReasoningTool use

Keep browsing