Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
GO
Google_Medgemma 1.5 4b It
Google · Bercraft
Params3.88B
Context128K
Q4_K_M2.5 GB
FO
FoxEngineAi Mega Destroyer 8x7B
Foxengineai · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
FL
flux kontext
Flux · gguf-org
Params11.9B
Context—
Q4_K_M6.9 GB
AU
AurelPx Percival 01 7b slerp
Aurelpx · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
Mythalion Kimiko v2
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
cognitivecomputations dolphin 2.9.1 llama 3 8b GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
sheep duck llama 2 70B v1.1
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
BI
Bielik 1.5B v3.0 Instruct
Bielik · second-state
Params1.6B
Context8K
Q4_K_M1.0 GB
QW
Qwen3 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
WA
Wan2.2 Fun 5B Control Camera
Wan · QuantStack
Params5.25B
Context—
Q4_K_M3.9 GB
SE
Wan2.1 T2V 1.3B SelfForcing VACE
Self · lym00
Params2.15B
Context—
Q4_K_M1.5 GB
AU
AutoGLM Phone 9B
Autoglm · BlcaCola
Params9.4B
Context64K
Q4_K_M6.2 GB
MI
MiniMax H3
Minimax · robertbschuette
Params20.1B
Context—
Q4_K_M18.2 GB
MI
Mistral7B PairRM SPPO Iter2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
rombodawg_losslessmegacoder-llama2-13b-mini
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
AI
airoboros l2 13b gpt4 m2.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SA
SakanaAI EvoLLM JP v1 7B
Sakanaai · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 1.7B
Qwen · QuantFactory
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
Qwen2 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama 3.1 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
PR
prometheus 7b v2 0
Prometheus · AlekseiPravdin
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 Swallow 30B A3B RL v0.2
Qwen · mmnga-o
Params30.5B
Context40K
Q4_K_M18.6 GB
KA
keynote-technology_kai-7b-instruct
Kai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LT
LTX 2.3
Ltx · nnick79
Params21B
Context—
Q4_K_M14.2 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context4K
Q4_K_M1.0 GB
CH
Chroma1 Base
Chroma · silveroxides
Params8.9B
Context—
Q4_K_M5.6 GB
LL
nousresearch_yarn-llama-2-7b-128k
Llama · TheBloke
Params6.74B
Context128K
Q4_K_M4.1 GB
LO
longchat 7b v1.5 32k
Longchat · shaowenchen
Params6.74B
Context32K
Smallest2.8 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
maldv winter garden 7b delta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB