Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
EX
EXAONE 3.5 2.4B Instruct 2
Exaone · ThomasBaruzier
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF
MI
Mistral 7B Instruct DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
ALMA 13B Pretrain
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
GGUF
SO
Solar 10.7B SLERP
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AI
airoboros l2 70B GPT4 2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MO
Moonlight 16B A3B Instruct
Moonlight · gabriellarson
Params16B
Context8K
Q4_K_M10.5 GB
GGUF
QW
Qwen/Qwen3-Next-80B-A3B-Instruct
Qwen · lefromage
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
OL
Olmo-3-1025-7B
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
GGUF
LL
Llama 2 13B Chat Dutch
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
SK
SkyReels V2 I2V 14B 720P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
MI
YuisekinAIEvol Mistral 7B ja math v0.1.1
Mistral · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
COTHuginn 4.5 19B
Cothuginn · TheBloke
Params19.4B
Context4K
Q4_K_M11.7 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · ThomasBaruzier
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
OP
weyaxi_openchat-3.5-1210-seraph-slerp
Openchat · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Meerkat 8b v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · gaianet
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
LI
Lily-Cybersecurity-7B-v0.2
Lily · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AM
llm360_amberchat
Amberchat · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
WA
wav2vec2 large xlsr 53 english
Wav · cstr
Params315M
Context—
Smallest0.2 GB
GGUF
WI
ehartford_wizardlm-30b-uncensored
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · NANI-Nithin
Params32.9B
Context1024K
Q4_K_M25.4 GB
GGUF
VI
vicuna 13B v1.5
Vicuna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FU
Fugaku-LLM-13B-instruct
Fugaku · mmnga
Params13.4B
Context2K
Q4_K_M9.6 GB
GGUF
SY
migtissera_synthia-70b-v1.2
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
CA
camel-ai_camel-13b-role-playing-data
Camel · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Roleplay
GE
Gemma 4 12B It
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision

Other quants

Keep browsing