Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
GR
Granite-3.3-8B-Instruct
Granite · unsloth
Params8.17B
Context128K
Q4_K_M4.9 GB
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
QU
Quest AI quest corruption 7b s375 v3 GRPO
Quest · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
JA
Jan v1 4B
Jan · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
LU
Menlo Lucy
Lucy · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
NE
Nemomix v2.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DR
DRT O1 7B
Drt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
GE
Gemma4 31b Gembrain Equinox
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
AN
AnubisLemonade 70B v1.1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OL
Olmo 3 7B Think
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
AV
Ava 1.0 12B
Ava · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
IN
Internvl3-14B-Instruct
Internvl · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
SA
Sarvam M
Sarvam · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
OP
OpenThinker Agent v1
Openthinker · bartowski
Params8.2B
Context40K
Q4_K_M5.0 GB
LU
Lucy 128k
Lucy · bartowski
Params1.72B
Context128K
Q4_K_M1.1 GB
LA
Lamarck 14B v0.7
Lamarck · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
IN
Internvl3-1B-Instruct
Internvl · unsloth
Params630M
Context32K
Q4_K_M0.5 GB
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
TE
Teuken 7B Instruct Research v0.4
Teuken · bartowski
Params7.45B
Context4K
Q4_K_M5.0 GB
IN
JanusCoderV 7B
InternLM · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
GR
Granite 4.0 Tiny Preview
Granite · bartowski
Params6.67B
Context1024K
Q4_K_M4.1 GB
HU
HuatuoGPT O1 8B
Huatuogpt · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
IN
Inf O1 Pi0
Inf · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
miniG
Minig · bartowski
Params9.5B
Context1024K
Q4_K_M6.3 GB
QW
Rombos Coder V2.5 Qwen 14b
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB