Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
Teuken 7B instruct research v0.4
Teuken · QuantFactory
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · second-state
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
SE
SeaLLM 7B Chat
Seallm · parinzee
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · leeminwaan
Params10.2B
Context128K
Q4_K_M7.7 GB
Tool use
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
QwQ 32B Preview
Qwen · mmnga
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
GE
Gemma 3 1b It
Gemma · gaianet
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · lainlives
Params8.95B
Context256K
Q4_K_M5.6 GB
RoleplayVision
QW
Qwen2.5 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · gabriellarson
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
QwenLong-L1.5-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
ReasoningTool use
GR
Granite 3.3 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H Tiny BE
Granite · taronaeo
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GE
Leniachat Gemma 2b v0
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TI
TinySlime-1.1B-v1.0
Tinyslime · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
OP
openNemo 9B abliterated
Opennemo · empero-ai
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
nvidia__NVIDIA Nemotron Nano 9B v2
Nemotron · dominguesm
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
GP
GPT OSS Cybersecurity Merged 20B Heretic Ara
gpt-oss · piotreknow02
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
VI
lmsys_vicuna-33b-v1.3
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GP
gpt-oss-20b-heretic
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
Tool use
LL
ArliAI Llama 3 8B Cumulus v0.3.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nirosunid Llama 3.1 8B bnb 4bit python v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
ChronoEdit
Chronoedit · vantagewithai
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
EM
EMO 1.5B GGUF smashed
Emo · PrunaAI
Params1.84B
Context4K
Q4_K_M1.2 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · second-state
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
ST
stable-code-instruct-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
CA
CAT Translate 0.8b
Cat · mmnga-o
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
GE
gemma-1.1-2b-it
Gemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Other quants

Keep browsing