Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
QW
VulnLLM-R-7B
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M4.9 GB
CY
Cydonia 22B v1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
IN
InternVL3_5 1B
Internvl · bartowski
Params752M
Context40K
Q4_K_M0.5 GB
CY
Cydonia R1 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
LF
LFM2 8B A1B
Lfm · bartowski
Params8.34B
Context125K
Q4_K_M5.1 GB
ST
Strawberrylemonade 70B v1.1
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
AF
AFM 4.5B
Afm · bartowski
Params4.62B
Context64K
Q4_K_M2.9 GB
AN
Anubis 70B v1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
SC
Schisandra
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
RA
X Ray_Alpha
Ray · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
QW
Qwen3.5 4B Qwensploit CyberSecurity
Qwen · xtools-at
Params4.21B
Context256K
Q4_K_M2.7 GB
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
CY
Cydonia_Vistral
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3 3B Instruct 2512
Mistral · EnlistedGhost
Params3.43B
Context256K
Smallest1.3 GB
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwentile2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Miril Drone 2B 1
Miril · bartowski
Params4.63B
Context128K
Q4_K_M3.4 GB