Q2_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
Falcon3 1B Base
Falcon · bartowski
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
IN
Infracelestial 27B
Infracelestial · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
ReasoningRoleplayTool use
DO
Dots.Llm1.Inst
Dots · bartowski
Params143B
Context32K
Q4_K_M96.1 GB
GGUF
SC
MS Schisandra 22B v0.3
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
NU
NuExtract 1.5 Smol
Nuextract · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
LY
MN Lyrebird 12B
Lyrebird · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HE
Helpingai3 Raw
Helpingai · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
TR
Trinity Large Preview
Trinity · arcee-ai
Params390B
Context—
Q4_K_M241.6 GB
GGUF
QW
zubr tiny 2b
Qwen · alekringtonnn-ai
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen3-8B
Qwen · cmp-nct
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
RE
Reka-Flash-3
Reka · unsloth
Params20.9B
Context32K
Q4_K_M13.6 GB
GGUF
DU
Dusk_Rainbow
Dusk · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 122B RpRMax v1
Qwen · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
KI
Kimi-K2-Instruct
Kimi · jobs-git
Params1030B
Context128K
Q4_K_M620.8 GB
CodingTool use
CO
Star Command R 32B v1
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
QW
QNS 2 ReLearn Preview
Qwen · mithulaartigala
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · XythicK
Params21.8B
Context128K
Q4_K_M13.3 GB
ReasoningTool use
DA
DatacampLlama 3.1 8B
Datacampllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · kolya32rus
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
QW
Qwerus 7B
Qwerus · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LF
Supra Title 350M exp
Lfm · SupraLabs
Params354M
Context125K
Q4_K_M0.2 GB
EmbeddingTool use
QW
Qwen2.5-Vl-7B-Instruct
Qwen · divyanshugaur
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
GR
GRMR 2B Instruct
Grmr · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Hermes-2-Theta-Llama-3-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
CA
Captain_BMO 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
GE
Gemma-3-1B-It
Gemma · stratalab-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
CA
arcee ai Caller
Caller · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
R1
R1 1776
unsloth
Params671B
Context160K
Q4_K_M404.4 GB
CodingReasoningTool use
BI
BigQwen2.5 125B Instruct
Bigqwen · bartowski
Params125B
Context32K
Q4_K_M81.6 GB
Tool use
ER
Ernie-4.5-300B-A47B-Pt
Ernie · unsloth
Params299B
Context128K
Q4_K_M180.2 GB
GGUF

Other quants

Keep browsing