Q4_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.6-35B-A3B
Qwen · lododoai
Params35.5B
Context256K
Smallest22.9 GB
DE
decision models stable fork
Decision · runanywhere
Params9.08B
Context512
Q4_K_M0.3 GB
GL
GLM 5.2
GLM · LaniakeaPH
Params754B
Context1024K
Q4_K_M465.8 GB
QW
Qwen3.8-27B
Qwen · huake
Params27.3B
Context256K
Q4_K_M16.5 GB
MU
Muse Glimmer 30B
Muse · lactroiii
Params27.9B
Context128K
Q4_K_M1.6 GB
AG
gl agent 1 27b
Agent · Loke-60000
Params26.9B
Context256K
Smallest2.0 GB
ME
Medgemma-27B-It
Medgemma · AestheticLabs
Params27B
Context128K
Q4_K_M16.5 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · EnlistedGhost
Params3.43B
Context256K
Q4_K_M2.2 GB
QW
Qwen3.5-9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.0 GB
GE
Gemma-4-31B-It
Gemma · ygoayu
Params30.7B
Context256K
Q4_K_M18.3 GB
QW
Qwen3.6-27B
Qwen · developerjeremylive
Params27.3B
Context256K
Q4_K_M17.1 GB
QW
Qwen3.5-9B
Qwen · rfisdhef
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3.6-27B
Qwen · acgs
Params26.9B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6-27B
Qwen · Fastiraz
Params27.3B
Context256K
Q4_K_M17.1 GB
DE
Qwen3 30B A3B Thinking Deepseek Distill 2507 v3.1 V2
DeepSeek · rodrigomt
Params30.5B
Context256K
Smallest13.8 GB
NO
North-Mini-Code-1.0
North · brodatech
Params30.5B
Context488K
Q4_K_M19.2 GB
GE
Gemma-3-12B-It
Gemma · fwwrsd
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.5-27B
Qwen · StiofanZ
Params26.9B
Context256K
Q4_K_M16.7 GB
QW
Qwen3.8 Flash Next
Qwen · LunarMoonar
Params177B
Context256K
Smallest111.3 GB
GE
Gemma 2 9b It SimPO
Gemma · pipihand01
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3.6-27B
Qwen · tybuddy
Params26.9B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 it
Gemma · tripolskypetr
Params30.7B
Context128K
Q4_K_M3.1 GB
QW
Qwen3.8-27B
Qwen · gihakkk
Params27.3B
Context256K
Q4_K_M16.5 GB
GE
gemma-4-E4B-it-heretic
Gemma · JMingo
Params7.46B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5-0.8B
Qwen · bubiche
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.6-27B
Qwen · Specialkek
Params27.3B
Context256K
Q4_K_M17.1 GB
QW
Qwen3.8 Flash Next
Qwen · SZYBKIMARCIN955
Params177B
Context256K
Smallest72.5 GB
QW
Qwen3.5-2B
Qwen · Jeney
Params1.88B
Context256K
Q4_K_M1.3 GB
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · Hagwell
Params31.6B
Context1024K
Q4_K_M23.9 GB
LL
Llama-3.2-1B-Instruct
Llama · Atomic-Germ
Params1.24B
Context128K
Q4_K_M0.8 GB