Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
GL
GLM 5.3 Flash
GLM · lazywold
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3 0.6B DASHQ Q2
Qwen · jkim96
Params596M
Context40K
Smallest0.2 GB
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · recursechat
Params8.03B
Context128K
Q4_K_M4.9 GB
ER
Ernie-4.5-0.3B-Pt
Ernie · Dc15er
Params361M
Context128K
Q4_K_M0.2 GB
GE
Gemma-4-E4B-It
Gemma · Arabic250
Params7.52B
Context128K
Q4_K_M5.0 GB
GL
GLM 5.3 Flash
GLM · Nil626yhh
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3.5-9B
Qwen · bogservi
Params8.95B
Context256K
Q4_K_M5.7 GB
GL
GLM 5.3 Flash
GLM · ashuaria
Params321B
Context1024K
Smallest93.1 GB
KI
penclaw Kimi K3.0 abliterated
Kimi · audnai
Params2780B
Context1024K
Smallest861.3 GB
OR
Ornith 1.0 35B
Ornith · Hagwell
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen3.5-4B
Qwen · MdSajjadurRahaman
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma-4-E4B-It
Gemma · qiufeng001
Params7.52B
Context128K
Q4_K_M5.0 GB
GL
GLM 4.7 PRISM Unsloth
GLM · AliceThirty
Params353B
Context198K
Smallest82.7 GB
SE
Seed Coder 8B Instruct DASHQ Q2
Seed · jkim96
Params8.25B
Context32K
Smallest2.7 GB
QW
Qwen3.5-4B
Qwen · nutyon1
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.5 27B DASHQ Q2
Qwen · jkim96
Params27B
Context256K
Smallest8.6 GB
OL
Olmo 3 7B Think DASHQ Q2
OLMo · jkim96
Params7.3B
Context64K
Smallest2.3 GB
MI
Devstral Small 2 24B Instruct 2512 DASHQ Q2
Mistral · jkim96
Params23.6B
Context384K
Smallest6.8 GB
GE
gen myanmar 4 E2B
Gemma · BaybeDragon
Params4.65B
Context128K
Q4_K_M3.1 GB
CH
chandra ocr 2 ggufs
Chandra · Yashp2003
Params4.96B
Context256K
Smallest2.6 GB
QW
Qwen3.5-4B
Qwen · dev-vinod
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma-4-12B-It
Gemma · vickersdp
Params11.9B
Context256K
Q4_K_M7.1 GB
QW
Qwen3.6 27B abliterated v2
Qwen · groxaxo
Params26.9B
Context256K
Smallest11.4 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · Nil626yhh
Params284B
Context1024K
Smallest10.9 GB
GR
granite 4.1 8b DASHQ Q2
Granite · jkim96
Params8.79B
Context128K
Smallest2.8 GB
GL
GLM 5.3 Flash
GLM · zurichquants
Params321B
Context1024K
Smallest93.1 GB
GE
gemma 4 E4B it qat
Gemma · manojbillionaire123
Params7.46B
Context128K
Smallest0.1 GB
DE
Deepseek-V4-Flash
DeepSeek · poppingstar
Params284B
Context1024K
Smallest82.5 GB
KI
Kimi-K3
Kimi · Amynnnn
Params2780B
Context1024K
Smallest594.0 GB
GL
compressed backup GLM 5.2
GLM · vinayakkamboj
Params754B
Context1024K
Q4_K_M465.8 GB