Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
MI
speechless-mistral-six-in-one-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 26B A4B It Qat
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
KU
Kukedlc NeuralSynthesis 7B v0.3
Kukedlc · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openaccess-ai-collective_minotaur-13b-fixed
Minotaur · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · second-state
Params1.1B
Context2K
Q4_K_M0.7 GB
TE
Tess 10.7B v1.5b
Tess · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
MX
MXLewdMini L2 13B
Mxlewdmini · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GU
timdettmers_guanaco-33b-merged
Guanaco · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
CodeLlama 7B KStack clean
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Mistral 7B Instruct v0.2 GGUF smashed
Mistral · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
UM
Umievo Itr012 Gleipnir 7B
Umievo · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
yeen214_llama2_7b_merge_orcafamily
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
SY
migtissera_synthia-7b-v1.5
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
WizardMath 13B V1.0
Wizardmath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
deepsex 34b
Deepsex · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
nousresearch_yarn-mistral-7b-64k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LU
Luban 13B
Luban · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
Stheno Inverted L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LT
LTX Video 0.9.5
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
JA
japanese-novel-gpt-j-6b
Japanese · mmnga
Params6.05B
Context2K
Q4_K_M3.7 GB
GP
openai community gpt2 GGUF smashed
Gpt · PrunaAI
Params124M
Context1K
Q4_K_M0.1 GB
JA
Jais-3-MoVA-36B-A4B
Jais · IFM
Params37.4B
Context512K
Q4_K_M22.4 GB
JI
jina reranker v1 tiny en
Jina · gpustack
Params33M
Context8K
Q4_K_M0.0 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · RichardErkhov
Params1.78B
Context128K
Q4_K_M1.1 GB
GE
rijgersberg_geitje-7b-chat
Geitje · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StableBeluga 7B
Stablebeluga · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB