Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama 3.1 chinese 8b it dpo
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SeaLLM3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
GR
Granite 3.2 8b Instruct
Granite · ibm-research
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
JS
jsfs11 MixtureofMerges MoE 2x7b SLERPv0.9
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
QW
Qwen Image Distill
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
SI
Silicon-Maid-7B
Silicon · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen2 Audio 7B Instruct
Qwen · second-state
Params7.75B
Context8K
Q4_K_M4.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · 234-45Qq
Params1.78B
Context128K
Smallest1.3 GB
Reasoning
SP
Spicyboros 13B 2.2
Spicyboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CA
CarbonVillain En 10.7B v4
Carbonvillain · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
SOLAR-10.7B-Instruct-v1.0
Solar · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CH
Ph3task3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
LL
Layerskip Llama3.2 1B
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
WA
Lynx
Wan · vantagewithai
Params2.1B
Context—
Q4_K_M0.2 GB
GGUF
MY
MythoMax-L2-13b
Mythomax · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
carperai_stable-vicuna-13b-delta
Stable · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
JO
JoyAI Image Edit Plus ComfyUI
Joyai · vantagewithai
Params16.3B
Context—
Q4_K_M11.6 GB
GGUF
EU
euclaise ReMask 3B
Euclaise · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
chinese llama 2 13b
Llama · hfl
Params13.3B
Context4K
Smallest5.0 GB
Coding
LL
Llama 3 Base 8B SFT DPO
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen Image 2512
Qwen · vantagewithai
Params20.4B
Context—
Q4_K_M13.0 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
PF
pfnet nekomata 14b pfn qfin
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
OP
OpenELM 3B
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
ST
L3-8B-Stheno-v3.1
Stheno · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
gemma-4-E4B-it
Gemma · Mungert
Params7.52B
Context128K
Q4_K_M6.2 GB
ReasoningTool use
TI
Tiamat 7b 1.1 Dpo
Tiamat · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 1.5 6B
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LL
ProjectZLLM SFT dna Llama 3.1 8B Instruct 20 r16 merged
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
TA
TableLLM 13b
Tablellm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF

Other quants

Keep browsing