Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
CursorCore QW2.5 1.5B SR
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
TI
TinyLlama v1.1
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen1.5-32B-Chat
Qwen · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
LL
Llama 2 7b Ebft Sparsegpt Outlier Wiki Block Outlier
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
granite-8b-code-instruct
Granite · SanctumAI
Params8.05B
Context4K
Q4_K_M4.9 GB
MA
Mamba gpt 3B v4 ggml and
Mamba · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
LL
LLaMA 3 8B SFR SFT R
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
vicgalle Configurable Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2 7B Instruct Step DPO
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
IN
instruction synthesizer
Instruction · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
gemma 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
llama2-7b-chat-hf-v3
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Mistral 7B Holodeck 1
Mistral · KoboldAI
Params7.24B
Context32K
Q4_K_M4.4 GB
MX
mxbai-rerank-large-v2
Mxbai · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
SE
SeaLLMs v3 1.5B Chat
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
MI
Mistral Ita 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mmnga
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
LLaMA2 13B TiefighterLR
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
SWE-agent-LM-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
LA
Lawma 8b
Lawma · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
adonlee_llama_2_13b_sft_v1
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LA
calderaai_30b-lazarus
Lazarus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GG
GGUFDumps
Ggufdumps · koboldcpp
Params20.1B
Context128K
Q4_K_M4.9 GB
CH
chinese alpaca 2 1.3b rlhf
Chinese · hfl
Params1.26B
Context4K
Smallest0.6 GB
TI
TinyLlama 1.1B Chat v0.2
Tinyllama · kirp
Params1.1B
Context2K
Q4_K_M0.7 GB
NE
Nete 13B
Nete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB