Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
neuralmagic Llama 2 7b evolcodealpaca
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
gemma 2 9b it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 270m
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
CA
Calme-7B-Instruct-v0.9
Calme · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PS
Psyfighter2 13B Vore
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
OP
OpenELM-1_1B-Instruct
Openelm · RichardErkhov
Params1.08B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 Coder 7B
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
GP
OpenAi GPT oss 20b MODERATE uncensored NEO Imatrix
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.8 GB
LL
Hermes 2 Pro Llama 3 8B
Llama · AlekseiPravdin
Params7.81B
Context8K
Q4_K_M4.8 GB
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · RichardErkhov
Params3.23B
Context128K
Q4_K_M2.0 GB
JO
JoyAI Echo
Joyai · realrebelai
Params12.2B
Context—
Q4_K_M15.7 GB
VE
Veena
Veena · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 0.6B Uncensored
Qwen · Null-Guard
Params596M
Context40K
Q4_K_M0.4 GB
GR
Granite 8b Code Instruct 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
MI
mistralai Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RW
rwkv7 g1h 2.9b i1
Rwkv · RemySkye
Params2.95B
Context1024K
Q4_K_M2.1 GB
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 14B_Uncencored_Instruct
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
ST
starcoderbase 7b
StarCoder · QuantFactory
Params7.5B
Context8K
Q4_K_M4.9 GB
OC
octo net
Octo · NexaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
BO
Bookworm 10.7B v0.4 DPO
Bookworm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
NE
NeuTTS Air
Neutts · BricksDisplay
Params262M
Context—
Q4_K_M0.3 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
FL
flux dev
Flux · gguf-org
Params123M
Context—
Q4_K_M6.7 GB
QW
VulnLLM-R-7B
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M4.9 GB