Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Mistral-Small-4-119B-2603
Mistral · stefan-terdell-cleura
Params119B
Context1024K
Q4_K_M73.7 GB
QW
Qwen3.8-27B
Qwen · AGW06
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5-9B
Qwen · seerware
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3.5-4B
Qwen · ente-ai
Params4.21B
Context256K
Q4_K_M2.7 GB
OR
Tiel Coder 35B A3B
Ornith · npario
Params34.7B
Context256K
Smallest0.2 GB
QW
Qwen3.6-35B-A3B
Qwen · AstroJes
Params35.5B
Context256K
Q4_K_M22.7 GB
QW
Qwen3.8-27B
Qwen · N8STORM
Params27.3B
Context256K
Q4_K_M16.5 GB
GL
Glm-4.7-Flash
GLM · tripolskypetr
Params29.9B
Context198K
Q4_K_M18.3 GB
QW
Qwen3.6 35B A3B DASHQ Q2
Qwen · jkim96
Params34.7B
Context256K
Smallest10.5 GB
QW
Qwen3.5-4B
Qwen · hikka2515
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.5-4B
Qwen · bubiche
Params4.21B
Context256K
Q4_K_M2.7 GB
MA
Mai-Ds-R1
Mai · unsloth
Params671B
Context160K
Q4_K_M404.7 GB
QW
Qwen3.6-35B-A3B
Qwen · developerjeremylive
Params35.5B
Context256K
Q4_K_M22.7 GB
GE
Gemma-3-1B-It
Gemma · Obaidhrhsl
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen3-4B-Instruct-2507
Qwen · Jeney
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8-27B
Qwen · wuji2006
Params27.3B
Context256K
Q4_K_M16.5 GB
GE
Gemma-3-4B-It
Gemma · socrate-tech
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma-4-26B-A4B-It
Gemma · wolfliu
Params25.2B
Context256K
Q4_K_M16.9 GB
OL
Olmo 3.1 32B Think DASHQ Q2
OLMo · jkim96
Params32.2B
Context64K
Smallest8.9 GB
QW
Qwen3.5-35B-A3B
Qwen · cmp-nct
Params34.7B
Context256K
Q4_K_M19.9 GB
GE
Gemma-3N-E4B-It
Gemma · BaybeDragon
Params6.87B
Context32K
Q4_K_M4.5 GB
QW
Qwen3.6-27B
Qwen · Ankushbl6
Params26.9B
Context256K
Q4_K_M16.8 GB
GE
Gemma-4-E2B-It
Gemma · bubiche
Params4.65B
Context128K
Q4_K_M3.1 GB
MI
Minimax-M3
Minimax · reduxv1
Params426B
Context1024K
Q4_K_M264.0 GB
GR
granite 4.1 3b DASHQ Q2
Granite · jkim96
Params3.4B
Context128K
Smallest1.0 GB
GE
Gemma-4-E2B-It
Gemma · ALexJM19
Params4.65B
Context128K
Q4_K_M3.1 GB
QW
Qwen3.5-9B
Qwen · Interlinkarts
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3.5-122B-A10B
Qwen · tybuddy
Params122B
Context256K
Q4_K_M74.3 GB
GE
Gemma-4-31B-It
Gemma · ipsarkar
Params30.7B
Context256K
Q4_K_M18.3 GB
GL
GLM 5.3
GLM · Coder40-95
Params754B
Context1024K
Smallest216.7 GB