Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
NX
Nxcode-CQ-7B-orpo
Nxcode · Monor
Params7.25B
Context64K
Q4_K_M4.7 GB
LL
Llama 3 8B Magpie Pro SFT 300K v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
IN
AlchemistCoder L 7B
InternLM · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
EV
Evolutions Reflex
Evolutionstory · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
codegemma 7b it GGUF smashed
Codegemma · PrunaAI
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · OuteAI
Params157M
Context2K
Q4_K_M0.1 GB
QW
Josiefied Qwen2.5 14B Instruct Abliterated v4
Qwen · Goekdeniz-Guelmez
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Jan-v2-VL-max
Qwen · janhq
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
Hermes 2 Theta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
MrRobotoAI llama3 8B Special Dark v3.1.2c
Llama · RichardErkhov
Params8B
Context1024K
Q4_K_M4.9 GB
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
KA
karakuri lm 7b apm v0.2
Karakuri · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
granite-3b-code-instruct
Granite · SanctumAI
Params3.48B
Context2K
Q4_K_M2.1 GB
SU
SupraTitle 50M
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
GE
gemma-4-E2B-it
Gemma · Mungert
Params4.65B
Context128K
Q4_K_M4.1 GB
LL
French-Alpaca-Llama3-8B-Instruct-v1.0
Llama · LiteLLMs
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 3 1b Pt
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
LL
Meta Llama Guard 2 8B GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
MA
Magnum Instruct DPO
Magnum · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
gemma 1.1 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
gemma 3 270m it
Gemma · Open4bits
Params268M
Context32K
Q4_K_M0.3 GB
TA
TAIDE LX 7B
Taide · QuantFactory
Params6.94B
Context4K
Q4_K_M4.2 GB
QW
Qwen3-VL-8B-Instruct
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
GR
Granite 4.1 30b
Granite · ibm-granite
Params28.9B
Context128K
Q4_K_M17.5 GB
LL
Llama 3 8B Instruct
Llama · hermes42
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 0.6B
Qwen · NANI-Nithin
Params752M
Context40K
Q4_K_M0.5 GB
LL
llama-joycaption-beta-one-hf-llava
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
LL
L3 Umbral Mind RP v3.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
JA
AI21-Jamba-Reasoning-3B
Jamba · Mungert
Params3.2B
Context256K
Q4_K_M2.0 GB