Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
QW
Qwen3.8-27B
Qwen · weareapexcreators
Params27.3B
Context256K
Smallest10.7 GB
LL
Llama-3.1-8B-Instruct
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
MU
Muse-Glimmer-30B
Muse · weareapexcreators
Params28B
Context128K
Smallest12.4 GB
KI
Kimi-K2-Instruct
Kimi · unsloth
Params1030B
Context128K
Q4_K_M620.8 GB
QW
Qwen2.5-Omni-7B
Qwen · unsloth
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Ministral-3-14B-Instruct-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.6 GB
ME
Medgemma-1.5-4B-It
Medgemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · huihui-ai
Params1.68B
Context1024K
Smallest0.6 GB
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
LA
Laguna-S-2.1
Laguna · unsloth
Params118B
Context256K
Q4_K_M73.1 GB
MI
minmax
Minmax · Kutches
Params20.1B
Context—
Q4_K_M11.5 GB
QW
Suri Qwen 3.8 27B Companion
Qwen · SpaceTimee
Params27.3B
Context256K
Q4_K_M16.5 GB
SM
Smollm3-3B
SmolLM · unsloth
Params3.08B
Context64K
Q4_K_M1.9 GB
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M23.9 GB
MI
Ministral-3-8B-Reasoning-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
MiniMax M3.1 Flash
Minimax · unsloth
Params426B
Context1024K
Smallest0.5 GB
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
QW
Qwen3-4B-Thinking-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Q4_K_M0.5 GB
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
NA
Nanonets-Ocr-S
Nanonets · unsloth
Params3.1B
Context125K
Q4_K_M1.9 GB