Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NI
Ninja v1
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
HE
Hexoteric 7B imatrix
Hexoteric · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 7b r
Xlam · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
OpenBuddy Llama2 13B v11.1
Llama · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
GO
gorilla-llm_gorilla-7b-hf-delta-v0
Gorilla · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
EV
L3 Evil Stheno v3.2 8B
Evil · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct function calling
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
GE
lemon mint gemma ko 7b instruct v0.71
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
wassimm Llama 3.1 8B psycology w 6k data
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
JI
jina embeddings v2 base de
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
SE
SeaLLM 7B v2.5
Seallm · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
Qwen3-TTS-12Hz-1.7B-Base
Qwen · FILM6912
Params3.1B
Context—
Smallest1.7 GB
GGUF
MI
jisukim8873 mistral 7B alpaca 1 epoch
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Bielik 11B v2.3 Instruct
Bielik · QuantFactory
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
CO
Yi Coder 9B Chat
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
TH
THaLLE 0.1 7B Fa
Thalle · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NU
NuminiLlama 3.1 8B
Numinillama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
Nemotron Research Reasoning Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
WI
WizardLM-7B-Uncensored
Wizardlm · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MA
macadeliccc magistrate 3.2 3b it
Macadeliccc · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
SQ
sqlcoder
Sqlcoder · QuantFactory
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
AI
henk717_airochronos-33b
Airochronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GR
Granite 4.0 350m Base
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · prithivMLmods
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
XD
xdan-ai_xdan-l1-chat-rl-v1
Xdan · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
FL
Flex.2 preview
Flex · Eviation
Params8.16B
Context—
Smallest1.7 GB
GGUF

Other quants

Keep browsing