Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Vikhr-Llama-3.2-1B-instruct
Llama · Vikhrmodels
Params1.24B
Context128K
Q4_K_M0.8 GB
SA
Salamandra 7b Instruct
Salamandra · RichardErkhov
Params7.77B
Context8K
Q4_K_M4.9 GB
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen3 Embedding 0.6B
Qwen · PeterAM4
Params596M
Context32K
Q4_K_M0.4 GB
PR
prometheus 13B v1.0
Prometheus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
stabilityai japanese stablelm base beta 70b
Stabilityai · RichardErkhov
Params1.6B
Context—
Q4_K_M0.0 GB
ST
starcoder2-7b
StarCoder · second-state
Params7.17B
Context16K
Q4_K_M4.4 GB
AM
llm360_amber
Amber · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
lightblue suzume llama 3 8B japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
NI
Nitral AI Eris PrimeV4.20 Vision 32k 7B
Nitral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
EU
Euryale 1.4 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
UM
Umt5 Xxl
Umt · chatpig
Params5.68B
Context512
Q4_K_M3.7 GB
CO
CodeUp Alpha 13B HF
Codeup · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
WA
wan s2v
Wan · calcuis
Params16.3B
Context—
Q4_K_M13.9 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
OR
Orca 2 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ER
ERNIE Image
Ernie · unsloth
Params8.03B
Context—
Q4_K_M5.0 GB
LL
dolphin 2.9 llama3 8b GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta llama_Meta Llama 3.1 8B Instruct
Llama · ThomasBaruzier
Params8B
Context128K
Q4_K_M4.9 GB
TI
py007_tinyllama-1.1b-python-v0.1
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
SY
Synthia 70B v1.2b
Synthia · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
FA
FashionGPT 70B V1.1
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GE
google gemma 2b it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
PL
Plamo 3 Nict 2b Base
Plamo · mmnga-o
Params2.6B
Context4K
Q4_K_M1.7 GB
GP
GPT2-774M-CINDER-SHOW-MULTI-CHAT
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
CA
camel-ai_camel-33b-combined-data
Camel · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
KA
keynote-technology_kai-7b-beta
Kai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
deepseek coder 6.7b instruct
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB