Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
GE
Gemma-3-270M-It
Gemma · Sci-fi-vy
Params268M
Context32K
Q4_K_M0.3 GB
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
EL
EleMo V3 Base
Elemo · Earlychildhoodeducation
Params27.3B
Context256K
Q4_K_M16.5 GB
IN
Internvl3-8B-Instruct
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
Qwen3-0.6B
Qwen · openwalrus
Params596M
Context40K
Q4_K_M0.4 GB
GL
GLM 5.3 Flash
GLM · Ashwinxs
Params321B
Context1024K
Smallest93.1 GB
IN
Internvl3-14B
Internvl · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
GL
GLM 5.3 Flash
GLM · AshwinX
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3-1.7B
Qwen · openwalrus
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Qwen3.8-27B
Qwen · SwinliQ-AIn-2
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3-4B
Qwen · openwalrus
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Dirk Qwen3.8 27B
Qwen · blackfan23
Params27.3B
Context256K
Smallest8.8 GB
GE
Gemma-4-31B-It
Gemma · Darkknight535
Params30.7B
Context256K
Q4_K_M18.3 GB
GE
Gemma-3-12B-It
Gemma · tripolskypetr
Params11.8B
Context128K
Q4_K_M7.3 GB
IN
Intellect-2
Intellect · unsloth
Params32.8B
Context40K
Q4_K_M19.9 GB
P1
P1 VL 235B A22B
axi0mX
Params235B
Context256K
Q4_K_M142.2 GB
QW
Qwen3-14B
Qwen · cmp-nct
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.5-9B
Qwen · cmp-nct
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3.6-35B-A3B
Qwen · andreaborio
Params35B
Context256K
Smallest12.3 GB
LF
LFM2.5-24B-A2B-Preview
Lfm · TechnoBaptist
Params24B
Context128K
Smallest7.5 GB
QW
Soob3123_Amoral Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Llama-3.3-70B-Instruct
Llama · axana-labs
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.5 2B
Qwen · dahara1
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.8-27B
Qwen · Aydge
Params27.3B
Context256K
Q4_K_M16.6 GB
IN
Internvl3-38B-Instruct
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
QW
Qwen3.8-27B
Qwen · Didkk
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · lovedheart
Params41B
Context256K
Smallest20.0 GB
GL
GLM 5.3 Flash
GLM · Kilka228
Params321B
Context1024K
Smallest93.1 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M15.0 GB