Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
UIGEN FX 4B Preview
Qwen · QuantFactory
Params4.4B
Context256K
Q4_K_M2.7 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · second-state
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
CO
C4Ai Command R7B Arabic 02 2025
Command R · matrixportalx
Params8.03B
Context16K
Q4_K_M5.1 GB
Tool use
QW
raspberry 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
HI
higgs
Higgs · calcuis
Params5.77B
Context—
Q4_K_M4.5 GB
GGUF
QW
Qwen3-0.6B-abliterated
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
EX
EXAONE 3.0 7.8B Instruct
Exaone · ThomasBaruzier
Params7.82B
Context4K
Q4_K_M4.8 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
CH
Chinese Alpaca 2 7B
Chinese · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GGUF
ZE
qblocks_zephyr_7b_norobots
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
YI
Yi 1.5 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
InstructLM 1.3B
Instructlm · QuantFactory
Params1.35B
Context2K
Q4_K_M0.8 GB
GGUF
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NA
Nanbeige 16B Chat 32K
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
Coding
MI
MiniChat 1.5 3B
Minichat · tsunemoto
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
QW
QwQ 32B
Qwen · brittlewis12
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TR
Trendyol LLM 7b chat dpo v1.0
Trendyol · tolgadev
Params7.34B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing