Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Replete AI_Replete LLM Qwen2 7b_Beta Preview
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
PL
Plamo 2 Translate
Plamo · mitmul
Params9.53B
Context10240K
Q4_K_M6.3 GB
EU
euclaise_ferret_7b
Euclaise · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 3 4B IT
Gemma · brittlewis12
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
pjev 2b
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
LL
OpenBioLLM Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
math shepherd mistral 7b prm
Mistral · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
QW
Qwen3.5 2B
Qwen · prithivMLmods
Params1.94B
Context256K
Q4_K_M1.3 GB
YI
Yi-1.5-9B-32K
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
GE
Gemma 2 9b It SimPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
KU
kukulemon-spiked-9B
Kukulemon · RichardErkhov
Params8.99B
Context8K
Q4_K_M5.4 GB
LL
Meta llama_Meta Llama 3.1 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mistral 7B OpenOrca
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
LocateAnything-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.4 GB
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
ST
Starling-LM-7B-beta
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Reflection Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
minimax h3 turbo
Minimax · udero
Params20.1B
Context—
Q4_K_M11.4 GB
BO
Boogu Image Edit GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Meta Llama 3 70B Instruct
Llama · hermes42
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
vicgalle Humanish Roleplay Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
FL
flux1 tests
Flux · TylorShine
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · salvibharti
Params7.62B
Context128K
Q4_K_M9.4 GB
ME
MergeMonster 13B 20231124
Mergemonster · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Theia Llama 3.1 8B v1
Llama · Chainbase-Labs
Params8B
Context128K
Q4_K_M4.9 GB
QW
UIGEN-X-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
BA
baichuan2 7b chat
Baichuan · shaowenchen
Params7.51B
Context4K
Smallest3.3 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Turkish Gemma 9b T1
Gemma · ytu-ce-cosmos
Params9.24B
Context8K
Q4_K_M5.8 GB