Q5_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
MI
Pixtral 12B Ollama
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
MiniCPM5-2B
MiniCPM · Mungert
Params2.52B
Context128K
Q4_K_M1.7 GB
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
PE
Q3 30b A3b Pentiment
Pentiment · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
OM
OmniCoder 9B
Omnicoder · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
LL
Trendyol LLM 8b Chat v2.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 VL 8B Thinking
Qwen · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LR
OrionLLM LRM 3.2
Lrm · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
PA
Pantheon Rp 1.6.1 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Grug 27b v1.1
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Ultra Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
FA
Falcon3 10B Instruct Abliterated
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Rombos LLM 70b Llama 3.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
Magnum v4 9b
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 14B Ft Limo
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen2.5 32B Instruct
Qwen · EasierAI
Params32.8B
Context32K
Q4_K_M19.9 GB
RE
Replete LLM Mist Nemo 12b test merged 250k
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GL
Glistening Gem 31B v2.0
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
GrayLine Qwen3 8B
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
BE
Beepo 22B
Beepo · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magidonia 24B v4.2.0
Magidonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GP
DMind-3
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB