Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
ML
mlfoundations dev stackoverflow 5000tasks 0p
Mlfoundations · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
qblocks_mistral_7b_norobots
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
YI
blossom v3 1 yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
MA
MaidStarling 2x7B Base
Maidstarling · RichardErkhov
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
CO
codegemma 2b GGUF smashed
Codegemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LT
LTX2.3 10Eros 1.3
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
OP
OpenELM 3B Instruct
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
LL
ZhangShenao SELM Llama 3 8B Instruct iter 2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
XW
Xwin LM 7B V0.1
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
lemon mint gemma ko 7b it v0.40
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
VI
Vinallama 7b Chat
Vinallama · RichardErkhov
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
CH
Chroma1 HD
Chroma · fairy322
Params8.9B
Context—
Q4_K_M5.6 GB
GGUF
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ShiningValiantXS
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BI
Bielik 7B v0.1
Bielik · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NX
Nxcode-CQ-7B-orpo
Nxcode · Monor
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
LL
Llama 3 8B Magpie Pro SFT 300K v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IN
AlchemistCoder L 7B
InternLM · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SA
Samantha 1.11 70B
Samantha · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
EV
Evolutions Reflex
Evolutionstory · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
codegemma 7b it GGUF smashed
Codegemma · PrunaAI
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
Lite-Mistral-150M-v2-Instruct
Mistral · OuteAI
Params157M
Context2K
Q4_K_M0.1 GB
GGUF
QW
Josiefied Qwen2.5 14B Instruct Abliterated v4
Qwen · Goekdeniz-Guelmez
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Jan-v2-VL-max
Qwen · janhq
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningVision
LL
Hermes 2 Theta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
MrRobotoAI llama3 8B Special Dark v3.1.2c
Llama · RichardErkhov
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF

Other quants

Keep browsing