Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
nousresearch_yarn-llama-2-13b-128k
Llama · TheBloke
Params13B
Context128K
Q4_K_M7.9 GB
LL
nousresearch_yarn-llama-2-13b-64k
Llama · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
D1
d1 3B
NANI-Nithin
Params2.7B
Context32K
Q4_K_M1.7 GB
PY
ajibawa-2023_python-code-33b
Python · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
IM
Z Image Turbo sdcpp
Image · wbruna
Params84M
Context—
Smallest0.2 GB
GR
Granite 4.0 1b
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
WH
whisper tiny
Whisper · oxide-lab
Params38M
Context—
Smallest0.0 GB
MI
MiniCPM5 1B
MiniCPM · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
LO
LoKuS 13B
Lokus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3-Coder-Next
Qwen · Mungert
Params79.7B
Context256K
Q4_K_M49.2 GB
LL
Llama3-Chinese-8B-Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
WA
WAI NSFW illustrious SDXL v110
Wai · kekusprod
Params2.57B
Context—
Smallest1.5 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
PE
Peach 2.0 9B 8k Roleplay
Peach · QuantFactory
Params8.8B
Context16K
Q4_K_M5.3 GB
FL
flux model
Flux · licyk
Params11.9B
Context512
Q4_K_M2.9 GB
MI
argilla_capybarahermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
Jan v2 VL med
Jan · janhq
Params8.2B
Context256K
Q4_K_M5.0 GB
CA
causallm_14b
TheBloke
Params14.2B
Context8K
Smallest8.2 GB
LO
LongCat Video Avatar ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.0 GB
LU
lumina
Lumina · calcuis
Params2.61B
Context—
Q4_K_M1.5 GB
NO
nousresearch_nous-capybara-7b-v1.9
Nous · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
codellama_codellama-13b-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
NO
Nous Hermes 2 SOLAR 10.7B
Nous · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Speechless Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
ehartford_dolphin-2.0-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ornith-1.5-9B
Ornith · Mungert
Params9.2B
Context256K
Q4_K_M6.1 GB
LF
LFM3 1.7B Heretic Abliterated i1
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
Qwen Image 2.1 Anime Fusal
Qwen · LocalAI-io
Params7.12B
Context256K
Q4_K_M5.0 GB