DeepSeek GGUF models
4419 GGUF models in the DeepSeek family, quantized by 1572 uploaders. Sizes run from 1M to 5376B parameters. The longest trained context is 1024K tokens.
DE
Deepseek R1 Distill Qwen 1.5b Unsloth Bnb 4bit
DeepSeek · Gaaiwing
Params1.78B
Context128K
Smallest1.9 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · BenevolenceMessiah
Params7.62B
Context128K
Smallest8.1 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Aldaris
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
Llama 70B DeepSeek R1 Distill
DeepSeek · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · TheGamerNew
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4 Flash
DeepSeek · anemll
Params7.31B
Context1024K
Smallest9.0 GB
DE
kubernetes operator 8b deepseek peft
DeepSeek · dereklck
Params8.03B
Context128K
Smallest8.5 GB
DE
deepseekQwen15Test
DeepSeek · Olbyer
Params1.78B
Context128K
Smallest1.9 GB
DE
deepseek r1 8b
DeepSeek · YoungC0320
Params8.03B
Context128K
Smallest4.9 GB
DE
Finance DeepSeek R1 Distill Llama 8B LoRA GGUF Q8 0
DeepSeek · heladell
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · recursechat
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek Fashion sims
DeepSeek · heosanghun
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · nguyenthilaitrieulong
Params32.8B
Context128K
Smallest34.8 GB
DE
assist llm
DeepSeek · data-niklas
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · salen-00
Params284B
Context1024K
Smallest102.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
DE
DeepSeek R1 Distill 1.5B Q4 K M
DeepSeek · jc-builds
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4 Flash
DeepSeek · rafw007
Params284B
Context1024K
Smallest86.7 GB
DE
Qwen3 4B distill deepseek opus gemini ethical
DeepSeek · ertghiu256
Params4.02B
Context40K
Q4_K_M2.5 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · ravenside
Params14.8B
Context128K
Smallest15.7 GB
DE
DeepSeek V2 Lite Chat Uncensored Unbiased
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Lucy-in-the-Sky
Params1.78B
Context128K
Smallest1.3 GB
DE
DeepSeek V3.1 HQ4 K
DeepSeek · anikifoss
Params671B
Context160K
Smallest442.5 GB
DE
deepseek-coder-6.7b-base
DeepSeek · icycodes
Params6.74B
Context16K
Smallest7.2 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · matrixportalx
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · Dodgy420
Params14.8B
Context128K
Smallest12.1 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest18.8 GB