Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3-ChatQA-1.5-8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
aloobun_bun_mistral_7b_v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
FLUX.1 Fill dev
Flux · gaianet
Params84M
Context—
Smallest0.3 GB
GGUF
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 14B sk
Qwen · worstplayer
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
RW
RWKV6 3B Chn UnlimitedRP Mini Chat HF
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
GGUF
GR
Granite 20b Code Instruct 8k
Granite · RichardErkhov
Params20.1B
Context8K
Q4_K_M12.8 GB
Coding
GE
gemma-2b
Gemma · leliuga
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
OP
OpenCoder 8B Instruct
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
LL
Bio Medical Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 E4B It Qat
Gemma · prithivMLmods
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
NU
NuExtract 2.0 8B
Nuextract · numind
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HU
Huginn 22B Prototype
Huginn · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
NO
LemonadeRP 4.5.3
Noromaid · TheBigBlender
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
llama-3-chinese-8b-instruct-v3
Llama · hfl
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Ft Mistral 7b Instruct v0.2 Sorry Bench 202406
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenOrca-Platypus2-13B
Openorca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama Guard 2 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · second-state
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
LL
Llama 3 Groq 70B Tool Use
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
FA
Falcon 11B
Falcon · QuantFactory
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
LL
Medichat Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TR
Triangulum 1B
Triangulum · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
ReasoningTool use
GE
saiga gemma2 10b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
QW
Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2
Qwen · Mungert
Params9.2B
Context256K
Q4_K_M6.6 GB
ReasoningTool useVision

Other quants

Keep browsing