Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
FA
Falcon-H1-1.5B-Deep-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
gemma 4 E2B it UD japanese imatrix
Gemma · dahara1
Params4.65B
Context128K
Q4_K_M3.1 GB
QW
Qwen3-Vl-8B-Thinking-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
QW
dnotitia_Smoothie Qwen3 4B
Qwen · Alcoft
Params4B
Context40K
Q4_K_M2.4 GB
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
YU
Ruach Studio Models v2
Yue · goldhub
Params632M
Context32K
Q4_K_M4.7 GB
AP
Apertus-70B-Instruct-2509
Apertus · unsloth
Params70.6B
Context64K
Q4_K_M43.7 GB
SE
Seed-Coder-8B-Instruct
Seed · unsloth
Params8.25B
Context32K
Q4_K_M5.1 GB
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · OS-Software
Params7.46B
Context128K
Smallest3.7 GB
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
LF
Lfm2.5-230M
Lfm · unsloth
Params230M
Context125K
Q4_K_M0.2 GB
QW
Qwen3.6-35B-A3B
Qwen · cmp-nct
Params34.7B
Context256K
Q4_K_M22.1 GB
MI
Magistral-Small-2506
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
NE
Nemotron-3.5-Bolt-E4B-Heretic
Nemotron · grumd0
Params7.46B
Context64K
Smallest3.7 GB
QW
Qwen3-235B-A22B-128K
Qwen · unsloth
Params235B
Context128K
Q4_K_M142.2 GB
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
MI
Mistral-Large-3-675B-Instruct-2512
Mistral · unsloth
Params675B
Context288K
Q4_K_M407.0 GB
QW
Occult Nail 1.0 35B A3B
Qwen · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
OL
Olmo-3-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
GE
Gemma-3-12B-It-Qat-Int4
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
HY
Hy-Mt2-1.8B
unsloth
Params1.79B
Context256K
Q4_K_M1.1 GB
QW
Qwen3-Vl-8B-Instruct-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
MI
Devstral Small 2507 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M14.5 GB
QW
Qwen3-Vl-32B-Instruct-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
QW
Qwen3-Vl-2B-Thinking-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
IN
Internvl3-78B-Instruct
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
Qwen3-4B-128K
Qwen · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
DE
Deepseek-V3-0324
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB