Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
brucethemoose_capytessborosyi-34b-200k-dare-ties
Capytessborosyi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
01 ai Yi 6B 200K
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
FL
FLUX.1 schnell
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GGUF
LL
codellama_codellama-7b-python-hf
Llama · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
qwen image
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
DI
discoresearch_discolm_german_7b_v1
Discolm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.5 122B DFlash2
Ornith · kaivoss
Params930M
Context256K
Q4_K_M0.6 GB
GGUF
LL
phind_phind-codellama-34b-python-v1
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
PH
dolphin 2 6 phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
CodingTool use
LL
CodeLlama 70B Python
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
WA
Wan2.1 T2V 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
UN
Uncensored Jordan 13B
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
Chronos Hermes 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
UN
ajibawa-2023_uncensored-jordan-33b
Uncensored · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
MI
sciphi_sciphi-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
LongCat Image Edit Turbo
Longcat · vantagewithai
Params6.29B
Context—
Q4_K_M3.9 GB
GGUF
RA
Raon 1 mini preview
Raon · NANI-Nithin
Params28.8B
Context256K
Q4_K_M19.7 GB
ReasoningTool use
LL
Nous Hermes Llama2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
QW
Qwen2.5 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
LL
harborwater_open-llama-3b-v2-wizard-evol-instuct-v2-196k
Llama · TheBloke
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
WI
ehartford_wizard-vicuna-7b-uncensored
Wizard · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · allenai
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
ehartford_wizardlm-1.0-uncensored-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
FI
Fibo 2.0 GGUFs
Fibo · realrebelai
Params8.23B
Context—
Smallest6.6 GB
GGUF
QW
qwen3 forced aligner 0.6b
Qwen · cstr
Params918M
Context—
Smallest0.5 GB
GGUF
MI
migtissera_synthia-moe-v3-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
GR
Granite 20b Code Instruct R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
CodingReasoning
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing