Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 Taiwan 8B Instruct
Llama · chienweichang
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Einstein-v6.1-LLama3-8B-Instruct-Ties
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Ko Luxia Instruct
Llama · QuantFactory
Params8.17B
Context8K
Q4_K_M5.0 GB
GGUF
XW
xwin-lm_xwincoder-13b
Xwincoder · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
MI
HannaHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
LL
Llama3 TAIDE LX 8B Chat Alpha1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
MiniMax H3
Minimax · myhuggingbb
Params20.1B
Context—
Q4_K_M18.2 GB
GGUF
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LZ
lzlv 70B
Lzlv · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GE
gemma 2b GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
CO
Yi Coder 9B
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
DE
Delexa-Instruct-V0.1-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniCPM4.1-8B
MiniCPM · Mungert
Params8.19B
Context64K
Q4_K_M5.1 GB
Reasoning
PH
phi3-4x4b-v1
Phi · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · RichardErkhov
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
CH
Ph3della3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NA
Nanbeige 16B Chat
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
Coding
QW
Qwen3 TTS 12Hz 1.7B CustomVoice
Qwen · BricksDisplay
Params694M
Context32K
Q4_K_M1.1 GB
GGUF
AN
Anything
Anything · mzwing
Params1.07B
Context—
Smallest1.3 GB
GGUF
LO
Loyal-Macaroni-Maid-7B
Loyal · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DA
pocketdoc_dans-adventurouswinds-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
NA
Nanbeige4.1 3B
Nanbeige · seanbailey518
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
FA
FastHunyuan
Fasthunyuan · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k GGUF v2
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
MI
llmware_dragon-mistral-7b-v0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing