Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
AP
Apertus-70B-Instruct-2509
Apertus · unsloth
Params70.6B
Context64K
Q4_K_M43.7 GB
CO
CogEvol 4B
Cogevol · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
SE
Seed-Coder-8B-Instruct
Seed · unsloth
Params8.25B
Context32K
Q4_K_M5.1 GB
GL
GLM 4.5 Air
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
RE
Replete-Coder-Instruct-8b-Merged
Replete · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CO
Codex 24B Small 3.2
Codex · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CA
Captain Eris Twighlight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LF
LFM2.5 2.6B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GE
Big Tiger Gemma 27B v3
Gemma · bartowski
Params28.4B
Context128K
Q4_K_M17.3 GB
CO
Command A Plus 05 2026
Command · bartowski
Params218B
Context195K
Q4_K_M135.1 GB
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GR
Granite 4.2 30b
Granite · bartowski
Params29.3B
Context128K
Q4_K_M18.0 GB
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
CY
Cydonia 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
NO
NousCoder 14B
Nouscoder · bartowski
Params14.8B
Context80K
Q4_K_M9.0 GB
EL
Steelskull L3.3 Electra R1 70b
Electra · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Emma 500 Llama2 7b
Llama · bartowski
Params6.74B
Context4K
Q4_K_M4.1 GB
SK
Skywork OR1 Math 7B
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Magistral-Small-2506
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
QW
Qwen3-235B-A22B-128K
Qwen · unsloth
Params235B
Context128K
Q4_K_M142.2 GB
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
IN
InternVL3_5 4B
Internvl · bartowski
Params4.41B
Context40K
Q4_K_M2.7 GB