Q5_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
GE
gemma-2-27b-it
Gemma · qwp4w3hyb
Params27.2B
Context8K
Smallest6.1 GB
PA
MS3.2 PaintedFantasy Visage 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
GE
gemma 4 A4B 98e v7 coder it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
MI
Tess 3 Mistral Nemo
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Karlsen Chat 27B abliterated
Qwen · karlsencoin
Params27.3B
Context256K
Q4_K_M16.6 GB
JA
Jan v3 4B Base Instruct
Jan · bartowski
Params4.41B
Context256K
Q4_K_M2.7 GB
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
NA
Nanbeige4.2-3B
Nanbeige · Mungert
Params4.17B
Context256K
Q4_K_M2.8 GB
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8-27B
Qwen · Mungert
Params27.3B
Context256K
Q4_K_M17.5 GB
QU
Quest AI quest corruption 7b s375 v3 GRPO
Quest · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
JA
Jan v1 4B
Jan · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
LU
Menlo Lucy
Lucy · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
NE
Nemomix v2.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DR
DRT O1 7B
Drt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
GE
Gemma4 31b Gembrain Equinox
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
OL
Olmo 3 7B Think
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
AV
Ava 1.0 12B
Ava · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
SA
Sarvam M
Sarvam · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
OP
OpenThinker Agent v1
Openthinker · bartowski
Params8.2B
Context40K
Q4_K_M5.0 GB
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
LU
Lucy 128k
Lucy · bartowski
Params1.72B
Context128K
Q4_K_M1.1 GB
LA
Lamarck 14B v0.7
Lamarck · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB