Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
MI
microsoft_WizardLM-2-7B
Microsoft · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
imajev 2b
Qwen · mindchain
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
WI
WizardLM 2 7B GGUF smashed
Wizardlm · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Sandbagging Cb New
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
ID
ideogram 4
Ideogram · molbal
Params9.28B
Context—
Smallest5.6 GB
CG
cgato TheSpice 7b FT ExperimentalOrca
Cgato · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BO
Boogu Image Turbo GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
LL
Llama 3 8B ProLong 64k Base
Llama · RichardErkhov
Params8B
Context64K
Q4_K_M4.9 GB
IN
Internlm2_5 7b Chat 1m
InternLM · duyntnet
Params7.74B
Context256K
Q4_K_M4.7 GB
NE
NeuTTS Nano
Neutts · BricksDisplay
Params262M
Context2K
Q4_K_M0.2 GB
GE
lei HuggingFace Gemma 2 9B 4bit Chat Level Measurement Guide 07242024
Gemma · RichardErkhov
Params3.4B
Context—
Q4_K_M1.7 GB
QW
Qwen3 0.6B
Qwen · QuantFactory
Params752M
Context40K
Q4_K_M0.5 GB
LL
Llama 3.2 1B Instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
DE
deepseek coder 6.7B kexer
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen3.5-35B-A3B
Qwen · Mungert
Params34.7B
Context256K
Q4_K_M21.6 GB
ZE
ZeusLabs Chronos Divergence 33B
Zeuslabs · RichardErkhov
Params32.5B
Context16K
Q4_K_M19.6 GB
GR
Granite Switch 4.1 8b
Granite · ibm-granite
Params8.97B
Context128K
Q4_K_M6.4 GB
ST
starcoder2 7b
StarCoder · QuantFactory
Params7.2B
Context16K
Q4_K_M4.5 GB
UP
upstage SOLAR 10.7B Instruct v1.0
Upstage · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Meissa Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
SK
SkyReels V2 T2V 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
LL
Openthai Llama Pretrained 7B
Llama · RichardErkhov
Params6.94B
Context4K
Q4_K_M4.2 GB
GE
Gemma 2 27b It
Gemma · ThomasBaruzier
Params27.2B
Context8K
Q4_K_M16.6 GB
MI
Mixtral 8x22B v0.1
Mistral · LiteLLMs
Params141B
Context64K
Q4_K_M85.6 GB
IN
Inv Konstanta V4 Alpha 7B
Inv · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
llama 2 7b chat catala
Llama · xaviviro
Params6.74B
Context4K
Q4_K_M4.1 GB
ST
Starcoder2 7b
StarCoder · QuantFactory
Params7.17B
Context16K
Q4_K_M4.5 GB
VI
vibevoice
Vibevoice · gguf-org
Params2.7B
Context—
Q4_K_M3.5 GB