Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PE
PersianMind v1.0
Persianmind · asedmammad
Params6.8B
Context2K
Q4_K_M4.1 GB
GGUF
NE
NexusRaven V2 13B
Nexusraven · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Evil Alpaca 3B L3.2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen3 32B
Qwen · second-state
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
DE
Deepseekmath 7b Sft MATH v2
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Qwen3.5 2B Opus46 Reasoning
Qwen · supersamdev
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
EM
emma 6
Emma · MrMeOrYou
Params1.55B
Context4K
Q4_K_M1.0 GB
Coding
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
KI
Kimi Dev 72B
Kimi · gabriellarson
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
MI
Elysia Trismegistus Mistral 7B
Mistral · HagalazAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama3 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
magnum v2 4b
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
llama 3.1 medprm reward v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 3B Vision BE
Granite · taronaeo
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
MI
undi95_mistral-claudelimarp-v3-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Math 7B Instruct
Qwen · second-state
Params7.62B
Context4K
Q4_K_M4.7 GB
CodingTool use
QW
polanka qwen2 1.5b v0.1 ckpt 401000
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
CO
Yi Coder 9B Chat
Coder · second-state
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
QU
Quill v1 imatrix
Quill · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GO
Gonzo Code 7B
Gonzo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
NY
beberik_nyxene-v3-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · second-state
Params108B
Context10240K
Q4_K_M65.4 GB
Tool useVision
LL
Sparse Llama 3.1 8B 2of4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3-16B-A3B
Qwen · Mungert
Params16B
Context40K
Q4_K_M10.0 GB
GGUF
SU
Supertron3 0.8B
Supertron · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
PH
calme 2.3 phi3 4b
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
BI
Biomistral Calme Instruct 7b
Biomistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LT
LTX 2.3 DISTILLED
Ltx · FenomAI
Params21B
Context—
Q4_K_M14.2 GB
GGUF
GE
Gemma 2 2b It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Other quants

Keep browsing