Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
IN
OREAL 32B
InternLM · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
ST
StarDust 12b v2
Stardust · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
TR
Trinity Large TrueBase
Trinity · bartowski
Params399B
Context8K
Q4_K_M241.6 GB
HE
Hercules Stheno v1
Hercules · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
AR
Art v0 3B
Art · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
PR
Nohobby L3.3 Prikol 70B v0.4
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
BE
Beeper King 22B
Beeper · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
OR
orpheus-finetuned-3b
Orpheus · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
QW
Qwen2.5-1.5B-Open-R1-GRPO
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Chuluun Qwen2.5 72B v0.08
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · Alcoft
Params3.08B
Context64K
Q4_K_M1.9 GB
GE
Gemma 2 27b Chatml
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
SK
Skyfall 39B V1A WS
Skyfall · bartowski
Params39B
Context128K
Q4_K_M23.4 GB
GE
gemma 4 31B it heretic QAT For Edge 16G
Gemma · SC117
Params30.7B
Context256K
Smallest12.3 GB
LL
Llama-3.2-1B-Instruct
Llama · RekcyDecky
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · cartoon45
Params30.5B
Context256K
Q4_K_M18.6 GB
LI
inclusionAI/Ling-1T
Ling · bartowski
Params1000B
Context32K
Q4_K_M608.4 GB
AT
Athene V2 Agent
Athene · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
PA
Pantheon Rp 1.6 12b Nemo Kto
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DA
Dans DangerousWinds V1.1.0 12b
Dans · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Q2.5 MS Mistoria 72b v2
Mistoria · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
YU
YuLan Mini
Yulan · diskrot
Params2.42B
Context28K
Q4_K_M1.8 GB
LI
ozone research 0x lite
Lite · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
Pixtral Large Instruct 2411
Mistral · EnlistedGhost
Params123B
Context128K
Smallest46.7 GB
NE
L3.1 nemotron sunfall v0.7.0
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
JE
Jedi 7B 1080p
Jedi · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
DU
Duet Minitron8b v0.5
Duet · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
DE
Qwen DeepSeek 1.5B Agentic distill
DeepSeek · koshuro
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama3.1 8b_codeio_pp
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB