Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
L3 Umbral Mind RP v3.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
TE
migtissera_tess-m-v1.1
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
JA
AI21-Jamba-Reasoning-3B
Jamba · Mungert
Params3.2B
Context256K
Q4_K_M2.0 GB
ReasoningTool use
QW
Qwen3 1.7B
Qwen · second-state
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
MI
embeddedllm_mistral-7b-merge-14-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
GE
gemma-2-9b-it
Gemma · second-state
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1b It
Gemma · DavidAU
Params1B
Context32K
Q4_K_M1.1 GB
GGUF
LL
h2oai h2ogpt 16k codellama 13b instruct
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M1.7 GB
Coding
LL
Llama2 Chat AYT 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
starcoder2-15b
StarCoder · RichardErkhov
Params16B
Context16K
Q4_K_M9.9 GB
Coding
LF
Claude
Lfm · FlameF0X
Params1.17B
Context125K
Q4_K_M0.7 GB
Reasoning
RW
RWKV 5.2 3B NSFW Role 16k
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · LiteLLMs
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Arabic-Orpo-Llama-3-8B-Instruct
Llama · MohamedRashad
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 4B
Qwen · AaryanK
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
NA
Nanbeige4.2-3B
Nanbeige · Mungert
Params4.17B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
JS
jsfs11 MixtureofMerges MoE 2x7b v7
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
ZE
zephyr 7b beta
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HY
digitous_13b-hypermantis
Hypermantis · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Roleplay
LL
OpenMath2 Llama3.1 8B
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Sentient 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
LL
ZhangShenao SELM Llama 3 8B Instruct iter 3
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CA
CAT Translate 1.4b
Cat · mmnga-o
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
LL
Llama3 Med42 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
gte-Qwen2-1.5B-instruct
Qwen · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingEmbedding
QR
Qra 7b Dolly Instruction 0.1
Qra · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Reasoning Llama 1b v0.1
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning

Other quants

Keep browsing