Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
QW
cerebras/Qwen3-Coder-REAP-363B-A35B
Qwen · unsloth
Params363B
Context256K
Q4_K_M219.3 GB
QW
Qwen3.6-35B-A3B
Qwen · Mspanz88
Params34.7B
Context256K
Q4_K_M22.1 GB
GE
Gemma-3-12B-It
Gemma · Abc7347
Params11.8B
Context128K
Q4_K_M7.3 GB
CO
context 1
Context · nicolasembleton
Params20.9B
Context128K
Q4_K_M15.8 GB
GE
Gemma-3-4B-It
Gemma · Abc7347
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Llama-3.2-3B-Instruct
Llama · mny1238
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3.5 2B DASHQ Q2
Qwen · jkim96
Params1.88B
Context256K
Smallest0.7 GB
GL
GLM 5.3 ewaste edition
GLM · SixVolts
Params753B
Context1024K
Smallest7.2 GB
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
GE
Gemma-3N-E4B-It
Gemma · Sci-fi-vy
Params6.87B
Context32K
Q4_K_M4.5 GB
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · AskMeCodes
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
shisa v2.1 llama3.2 3b UD japanese imatrix
Llama · dahara1
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
Magistral Small 2507 DASHQ Q2
Mistral · jkim96
Params23.6B
Context40K
Smallest6.8 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
MI
Mistral Small 3.1 24B Instruct 2503 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
MI
Mistral Small 3.2 24B Instruct 2506 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
OR
cn3nctie2nc92bbc9nxxj93
Ornith · AIGAROU
Params447M
Context256K
Smallest12.7 GB
QW
Qwen3.8-27B
Qwen · xShubx
Params27.3B
Context256K
Q4_K_M16.5 GB
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · XythicK
Params8.19B
Context128K
Q4_K_M5.0 GB
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · lovedheart
Params48.9B
Context256K
Smallest22.9 GB
GE
Gemma-3-4B-It
Gemma · tripolskypetr
Params3.88B
Context128K
Q4_K_M2.5 GB
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
QW
Qwen3.8 27B ComfyUI
Qwen · Rom3rk
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6-35B-A3B
Qwen · Shananhux
Params34.7B
Context256K
Q4_K_M22.1 GB
MI
Devstral Small 2507 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
GE
Gemma-3-1B-It
Gemma · tripolskypetr
Params1B
Context32K
Q4_K_M0.8 GB
IN
Internvl3-38B
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
QW
Qwen3.8-27B
Qwen · Sh200126
Params27.3B
Context256K
Q4_K_M16.6 GB
SU
SU 01
axi0mX
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · therickcain
Params1.68B
Context1024K
Smallest0.6 GB