Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llm Jp 3 7.2b
Llm · mmnga
Params7.29B
Context4K
Q4_K_M4.5 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
toxicqa Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen Image 2.1 SYCL Turbo
Qwen · Frosty40
Params7.12B
Context—
Smallest5.1 GB
GGUF
GR
v1olet_v1olet_merged_dpo_7b_v3
Greennode · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LI
A.X-4.0-Light
Light · Mungert
Params7.26B
Context16K
Q4_K_M4.5 GB
GGUF
CO
VL 1 Coder Heretic
Coder · haffner
Params7.62B
Context32K
Smallest1.4 GB
CodingReasoningTool use
GT
gte-large
Gte · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
Embedding
QU
quietstar 8 ahead
Quietstar · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
chinese text correction 1.5b
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
Qwen2.5-VL-32B-Instruct
Qwen · Mungert
Params32.8B
Context125K
Q4_K_M20.1 GB
Vision
GE
gemma 4 12b it MTP
Gemma · cloudnathan5
Params423M
Context256K
Q4_K_M0.3 GB
GGUF
PI
maywell_pivot-0.1-evil-a
Pivot · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 160m
Llama · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
ZA
Zarablend MX L2 7B
Zarablend · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MO
Hy Motion1.0
Motion · Aero-Ex
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
PH
Phi 3 medium 4k instruct
Phi · second-state
Params14B
Context4K
Q4_K_M8.6 GB
Coding
MI
openbuddy_openbuddy-mistral-7b-v13
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 1b fc r
Xlam · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 5p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
UN
fblgit_unaversal-8x7b-v1beta
Unaversal · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · second-state
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
AS
DarkArtsForge__Asmodeus 24B v2
Asmodeus · Naphula-Archives
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
WI
wizardlm_wizardmath-7b-v1.0
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5-7B-Instruct-kowiki-qa-context
Qwen · teddylee777
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · andrijdavid
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
MI
OpenHermes 2.5 Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
PH
Phi 3 medium 128k instruct imatrix
Phi · hermes42
Params14B
Context128K
Q4_K_M8.6 GB
CodingTool use

Other quants

Keep browsing