Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LT
ltxv0.9.7
Ltx · calcuis
Params13B
Context—
Q4_K_M9.1 GB
GGUF
QW
Qwen3 Reranker 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
Embedding
LL
ehartford_dolphin-llama-13b
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
ST
dolphincoder-starcoder2-7b
StarCoder · bartowski
Params7.4B
Context16K
Q4_K_M4.6 GB
CodingTool use
GO
gorilla openfunctions v1
Gorilla · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
YI
dolphin 2.9.1 yi 1.5 9b
Yi · QuantFactory
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · BasedAGI
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MI
K2S3 Mistral 7b v1.4
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
UM
Umievo itr012 Gleipnir 7B
Umievo · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CS
CSM 1B
Csm · BricksDisplay
Params457M
Context—
Q4_K_M0.8 GB
GGUF
LL
CodeLlama 7B Kexer
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
BA
weyaxi_bagel-hermes-2x34b
Bagel · TheBloke
Params60.8B
Context195K
Q4_K_M36.7 GB
Tool use
IC
ichigoberry MonarchPipe 7B slerp
Ichigoberry · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
aixsatoshi Honyaku Multi Translator Swallow ms7b
Aixsatoshi · mmnga
Params7.3B
Context32K
Q4_K_M4.4 GB
GGUF
DE
hkust-nlp_deita-7b-v1.0-sft
Deita · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Einstein v6.1 Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 Coder 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
OM
omnigen2
Omnigen · calcuis
Params3.97B
Context—
Q4_K_M6.0 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
EU
Eurus 7b sft
Eurus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
FA
falcon mamba 7b instruct
Falcon · QuantFactory
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
MI
flammenai flammen18 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Falcon
Falcon · QuantFactory
Params6.92B
Context2K
Q4_K_M4.8 GB
GGUF
LO
sanjiwatsuki_loyal-macaroni-maid-7b
Loyal · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
HelpingAI 3B hindi
Helpingai · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
OU
OuteTTS 1.0 0.6B
Outetts · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
GGUF
MI
fpham_karen_theeditor_v2_creative_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
janhq_pandora-v1-10.7b
Pandora · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
Llama 3.2 Taiwan Legal 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
NU
NuExtract 2.0 2B
Nuextract · numind
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision

Other quants

Keep browsing