Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Llama 3.1 8B EZO 1.1 it
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
NE
neuronovo_neuronovo-7b-v0.3
Neuronovo · TheBloke
Params8.99B
Context32K
Q4_K_M5.4 GB
WI
junelee_wizard-vicuna-13b
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
SK
SkyReels V2 T2V 14B 540P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
MI
PVD 160k Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss-dare-ties
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
Llama SEA LION v3 70B IT
Llama · aisingapore
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
StellarBright
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
IA
Iambe Storyteller 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
LE
leolm_leo-hessianai-7b
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
MI
K2S3 Mistral 7b v1.48
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
MA
MAmmoTH 13B
Mammoth · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
open-orca_llongorca-7b-16k
Llongorca · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
lvkaokao_mistral-7b-finetuned-orca-dpo-v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenELM-450M
Openelm · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
MI
MiniMax H3
Minimax · Derdisirtlan
Params20.1B
Context—
Smallest11.4 GB
PL
Platypus2 70B Instruct
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
llm compiler 7b
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
NE
nexusflow_nexusraven-13b
Nexusraven · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
SP
speakleash Bielik 7B Instruct v0.1
Speakleash · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GE
Gemma 4 31B It
Gemma · giladgd
Params30.7B
Context256K
Q4_K_M18.7 GB
ST
sd3.5 large
Stable · gguf-org
Params695M
Context—
Smallest0.2 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
TW
TwinLlama 3.1 8B
Twinllama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
XX
T5 V1_1 Xxl
Xxl · chatpig
Params4.76B
Context512
Q4_K_M2.9 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
QW
QwQ 32B
Qwen · duyntnet
Params32.8B
Context40K
Q4_K_M19.9 GB
SA
Sarah StoryTeller 13b
Sarah · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB