Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Llama 3 Taiwan 8B Instruct
Llama · chienweichang
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Einstein-v6.1-LLama3-8B-Instruct-Ties
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Ko Luxia Instruct
Llama · QuantFactory
Params8.17B
Context8K
Q4_K_M5.0 GB
XW
xwin-lm_xwincoder-13b
Xwincoder · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
MI
HannaHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
LL
Llama3 TAIDE LX 8B Chat Alpha1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniMax H3
Minimax · myhuggingbb
Params20.1B
Context—
Q4_K_M18.2 GB
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LZ
lzlv 70B
Lzlv · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GE
gemma 2b GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
CO
Yi Coder 9B
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
DE
Delexa-Instruct-V0.1-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM4.1-8B
MiniCPM · Mungert
Params8.19B
Context64K
Q4_K_M5.1 GB
PH
phi3-4x4b-v1
Phi · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · RichardErkhov
Params1.78B
Context32K
Q4_K_M1.1 GB
CH
Ph3della3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
NA
Nanbeige 16B Chat
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
QW
Qwen3 TTS 12Hz 1.7B CustomVoice
Qwen · BricksDisplay
Params694M
Context32K
Q4_K_M1.1 GB
AN
Anything
Anything · mzwing
Params1.07B
Context—
Smallest1.3 GB
LO
Loyal-Macaroni-Maid-7B
Loyal · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
DA
pocketdoc_dans-adventurouswinds-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
NA
Nanbeige4.1 3B
Nanbeige · seanbailey518
Params3.93B
Context256K
Q4_K_M2.4 GB
FA
FastHunyuan
Fasthunyuan · city96
Params12.8B
Context—
Q4_K_M7.9 GB
LL
Llama 3 8B Instruct Gradient 1048k GGUF v2
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
MI
llmware_dragon-mistral-7b-v0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB