Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
FO
Foundation-Sec-8B-Instruct
Foundation · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
GGUF
ST
stable-code-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
ELYZA-japanese-Llama-2-7b-instruct
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
firefly llama2 7B chat
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GGUF
VE
UI Venus 2 9B
Venus · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
MI
Clinical BR Mistral 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
hf 100 Llama 3.1 Spellbound StoryWriter 70b instruct 0.3 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Midm-2.0-Base-Instruct
Midm · Mungert
Params11.5B
Context32K
Q4_K_M7.1 GB
Tool use
SU
Supra 1.5 50M Instruct Exp Gguf Src
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
GGUF
ST
L3 8B Stheno v3.3 32K
Stheno · QuantFactory
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B Chinese Chat
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · andrijdavid
Params4.43B
Context—
Q4_K_M2.9 GB
GGUF
XW
Xwin MLewd 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
OpenMath-CodeLlama-7b-Python-hf
Llama · Mungert
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwen2.5 Coder 32B Instruct
Qwen · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
QW
Qwen2.5 1.5B Auto FunctionCaller
Qwen · sinatras
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
BE
beomi Yi Ko 34B Chat Preview
Beomi · RichardErkhov
Params34.6B
Context2K
Q4_K_M20.8 GB
GGUF
MI
speechlessai_speechless-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AZ
MN Halide 12b v1.0
Azure · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
GL
Glm Edge V 2b
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
Vision
GE
Gemma 4 Rust Coder
Gemma · Titaniumclock
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
SA
saishf Top Western Maid 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Schematron-3B
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen3.5 2B Base
Qwen · titan0115
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
MA
Matter 0.1 7B DPO preview
Matter · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RW
RWKV7 2.9B v3 UnlimitedRP Mini Novel Chat Preview
Rwkv · mzwing
Params2.95B
Context1024K
Q4_K_M1.9 GB
GGUF
SP
Spicyboros 7B 2.2
Spicyboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OU
OuteTTS 0.3 1B
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
GGUF
KO
komodo 7b base
Komodo · ukung
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing