Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LE
sanjiwatsuki_lelantos-maid-dpo-7b
Lelantos · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Coding
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
TO
llm-agents_tora-code-7b-v1.0
Tora · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LE
leolm_leo-hessianai-70b-chat
Leo · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
UC
UCLA AGI zephyr 7b sft full SPIN iter2
Ucla · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NI
NicholasCorrado zephyr 7b uf rlced conifer dpo 2e
Nicholascorrado · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chronorctypus Limarobormes 13b
Chronorctypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
QW
Qwen2.5 Coder 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
MO
MoMo 70B V1.1
Momo · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
CodingTool use
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
ME
Megamind v2 VL high
Megamind · digitranslab
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
LL
cognitivecomputations dolphin 2.9 llama3 8b
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SK
skywork_skywork-13b-base
Skywork · TheBloke
Params13.9B
Context128K
Q4_K_M8.4 GB
GGUF
FR
fredithefish_openzephyrchat
Fredithefish · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
notus 7b v1
Notus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KR
Krea 2 Turbo
Krea · stduhpf
Params12.9B
Context—
Smallest4.9 GB
GGUF
BA
T5 Base
Base · chatpig
Params223M
Context512
Q4_K_M0.1 GB
Coding
KU
KukulStanta InfinityRP 7B slerp
Kukulstanta · AlekseiPravdin
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
vicgalle Configurable Janus 7B
Vicgalle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MI
failspy Codestral 22B v0.1 abliterated v3
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
CA
Camel Platypus2 13B
Camel · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LA
labse
Labse · ChristianAzinn
Params470M
Context512
Q4_K_M0.4 GB
Embedding
MI
AmeerH Mistral Math 2x7b mix
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
open-orca_mixtral-slimorca-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Qwen3.5 4B
Qwen · prithivMLmods
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision

Other quants

Keep browsing