Q4_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
P1
P1 VL 235B A22B
axi0mX
Params235B
Context256K
Q4_K_M142.2 GB
QW
Qwen3-14B
Qwen · cmp-nct
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.5-9B
Qwen · cmp-nct
Params8.95B
Context256K
Q4_K_M5.7 GB
MI
Ministral 3 8B Instruct 2512
Mistral · EnlistedGhost
Params8.49B
Context256K
Smallest3.9 GB
LF
LFM2.5-24B-A2B-Preview
Lfm · TechnoBaptist
Params24B
Context128K
Smallest7.5 GB
QW
Qwen3.6-27B
Qwen · AtomicChat
Params461M
Context256K
Smallest16.8 GB
QW
Soob3123_Amoral Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Llama-3.3-70B-Instruct
Llama · axana-labs
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.5 2B
Qwen · dahara1
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.8-27B
Qwen · Aydge
Params27.3B
Context256K
Q4_K_M16.6 GB
IN
Internvl3-38B-Instruct
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
QW
Qwen3.8-27B
Qwen · Didkk
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · lovedheart
Params41B
Context256K
Smallest20.0 GB
GL
GLM 5.3 Flash
GLM · Kilka228
Params321B
Context1024K
Smallest93.1 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M15.0 GB
QW
cerebras/Qwen3-Coder-REAP-363B-A35B
Qwen · unsloth
Params363B
Context256K
Q4_K_M219.3 GB
QW
Qwen3.6-35B-A3B
Qwen · Mspanz88
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen3.8 27B MTP Heretic Ja
Qwen · OS-Software
Params461M
Context256K
Q4_K_M16.8 GB
GE
Gemma-3-12B-It
Gemma · Abc7347
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma4 e4b it
Gemma · AlexAtomic
Params7.52B
Context128K
Q4_K_M5.3 GB
CO
context 1
Context · nicolasembleton
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
Swift 1.5 Qwen3.8 Flash Next Q4 K XL
Qwen · ethanwtodd
Params177B
Context256K
Smallest111.3 GB
GR
Granite 4.0 H Small Heretic High
Granite · rodrigomt
Params32.2B
Context1024K
Smallest18.8 GB
GE
Gemma-3-4B-It
Gemma · Abc7347
Params3.88B
Context128K
Q4_K_M2.5 GB
OR
Ornith 9B
Ornith · AtomicChat
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama-3.2-3B-Instruct
Llama · mny1238
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3.8-27B
Qwen · SixVolts
Params27.3B
Context256K
Smallest1.1 GB
GR
GRM 2.6 Plus 0628 MTP reasoning i1
Grm · DAXZEIT
Params27.3B
Context256K
Q4_K_M17.6 GB
GL
GLM 5.3 ewaste edition
GLM · SixVolts
Params753B
Context1024K
Smallest7.2 GB
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB