Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
FA
Falcon3 1B Base
Falcon · bartowski
Params1.67B
Context4K
Q4_K_M1.1 GB
IN
Infracelestial 27B
Infracelestial · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
DO
Dots.Llm1.Inst
Dots · bartowski
Params143B
Context32K
Q4_K_M96.1 GB
SC
MS Schisandra 22B v0.3
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
NU
NuExtract 1.5 Smol
Nuextract · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
LY
MN Lyrebird 12B
Lyrebird · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Helpingai3 Raw
Helpingai · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
TR
Trinity Large Preview
Trinity · arcee-ai
Params390B
Context—
Q4_K_M241.6 GB
QW
zubr tiny 2b
Qwen · alekringtonnn-ai
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3-8B
Qwen · cmp-nct
Params8.19B
Context40K
Q4_K_M5.0 GB
RE
Reka-Flash-3
Reka · unsloth
Params20.9B
Context32K
Q4_K_M13.6 GB
DU
Dusk_Rainbow
Dusk · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
QW
Qwen3.5 122B RpRMax v1
Qwen · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
KI
Kimi-K2-Instruct
Kimi · jobs-git
Params1030B
Context128K
Q4_K_M620.8 GB
CO
Star Command R 32B v1
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
QW
QNS 2 ReLearn Preview
Qwen · mithulaartigala
Params1.94B
Context256K
Q4_K_M1.3 GB
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · XythicK
Params21.8B
Context128K
Q4_K_M13.3 GB
DA
DatacampLlama 3.1 8B
Datacampllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · kolya32rus
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwerus 7B
Qwerus · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LF
Supra Title 350M exp
Lfm · SupraLabs
Params354M
Context125K
Q4_K_M0.2 GB
QW
Qwen2.5-Vl-7B-Instruct
Qwen · divyanshugaur
Params7.62B
Context125K
Q4_K_M4.7 GB
GR
GRMR 2B Instruct
Grmr · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Hermes-2-Theta-Llama-3-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
CA
Captain_BMO 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma-3-1B-It
Gemma · stratalab-org
Params1B
Context32K
Q4_K_M0.8 GB
CA
arcee ai Caller
Caller · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
R1
R1 1776
unsloth
Params671B
Context160K
Q4_K_M404.4 GB
BI
BigQwen2.5 125B Instruct
Bigqwen · bartowski
Params125B
Context32K
Q4_K_M81.6 GB
ER
Ernie-4.5-300B-A47B-Pt
Ernie · unsloth
Params299B
Context128K
Q4_K_M180.2 GB