Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
jevk5 9b v0.3.3
Qwen · mindchain
Params8.95B
Context256K
Q4_K_M5.6 GB
SO
KoSOLAR 10.7B v0.2
Solar · QuantFactory
Params10.8B
Context4K
Q4_K_M6.5 GB
ME
Meltemi 7B Instruct v1.5
Meltemi · RichardErkhov
Params7.48B
Context32K
Q4_K_M4.5 GB
ST
starcoder2 3b instruct
StarCoder · QuantFactory
Params3.03B
Context16K
Q4_K_M1.9 GB
MI
chihoonlee10 T3Q EN DPO Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB
FS
FsfairX-Zephyr-Chat-v0.1
Fsfairx · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8b 64k PoSE GGUF smashed
Llama · PrunaAI
Params8B
Context128K
Q4_K_M4.9 GB
LL
llm compiler 7b ftd
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
DI
DialoGPT medium Loki
Dialogpt · QuantFactory
Params163M
Context1K
Q4_K_M0.1 GB
QW
Qwen3.5 2B
Qwen · AaryanK
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
Llama-3-8B-Synthia-v3.5
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
GE
Pullulation 2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2.5 7B Gutenberg KTO
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
QW
CodeQwen1.5 7B Chat
Qwen · QuantFactory
Params7.25B
Context64K
Q4_K_M4.7 GB
LL
LlamaCorn 1.1B Chat
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
Gemma 2 Ifable 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama3.2 3B Esper2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
UserLM-8b
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.3 GB
IC
icefog72 IceLemonTeaRP 32k 7b
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
Kunoichi-DPO-v2-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Unichat llama3 Chinese 8B GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
Codepy Deepthink 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
LLaMA2 13B Holomax
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.1 8B Ultra Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · samgreen
Params689M
Context125K
Q4_K_M19.9 GB
QW
Qwen Image Edit 2511
Qwen · Daex032
Params20.4B
Context—
Q4_K_M13.2 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
WH
whisper small
Whisper · oxide-lab
Params242M
Context—
Smallest0.1 GB