Q4_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5-2B
Qwen · Xlnk
Params1.88B
Context256K
Q4_K_M1.3 GB
GE
translate gemma 4 sub e2b
Gemma · 17slever17
Params4.65B
Context128K
Smallest0.1 GB
GR
Groot 238B A18B 261023
Groot · GrootTeam
Params243B
Context1024K
Smallest152.2 GB
GE
Gemma-4-12B-It
Gemma · sebidev
Params11.9B
Context256K
Q4_K_M7.1 GB
GL
GLM 5.3 Flash
GLM · bytehackr
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3.6-35B-A3B
Qwen · Deepdive404
Params34.7B
Context256K
Q4_K_M22.1 GB
LF
LFM2.5 24B A2B Uncensored
Lfm · electroglyph
Params24B
Context128K
Smallest14.9 GB
MI
Mistral-Small-4-119B-2603
Mistral · stefan-terdell-cleura
Params119B
Context1024K
Q4_K_M73.7 GB
GE
Gemma 4 12B StyleTune QAT
Gemma · alexisStacksCode
Params11.9B
Context256K
Smallest0.3 GB
QW
Qwen3.8-27B
Qwen · AGW06
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5-9B
Qwen · seerware
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3.5-4B
Qwen · ente-ai
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Atomic Chat / Qwen3.5 4B
Qwen · AlexAtomic
Params4.21B
Context256K
Q4_K_M2.7 GB
OR
Tiel Coder 35B A3B
Ornith · npario
Params34.7B
Context256K
Smallest0.2 GB
QW
Qwen3.6-35B-A3B
Qwen · AstroJes
Params35.5B
Context256K
Q4_K_M22.7 GB
QW
Qwen3.8-27B
Qwen · N8STORM
Params27.3B
Context256K
Q4_K_M16.5 GB
GL
Glm-4.7-Flash
GLM · tripolskypetr
Params29.9B
Context198K
Q4_K_M18.3 GB
QW
Qwen3.5-4B
Qwen · hikka2515
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.5-4B
Qwen · bubiche
Params4.21B
Context256K
Q4_K_M2.7 GB
MA
Mai-Ds-R1
Mai · unsloth
Params671B
Context160K
Q4_K_M404.7 GB
QW
Qwen3.6-35B-A3B
Qwen · developerjeremylive
Params35.5B
Context256K
Q4_K_M22.7 GB
QW
Qwen3.6 35B A3B REAM 160 ru agent GGUF MTPLess
Qwen · BahamutRU
Params35B
Context—
Q4_K_M13.8 GB
GE
Gemma-3-1B-It
Gemma · Obaidhrhsl
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen3-4B-Instruct-2507
Qwen · Jeney
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8-27B
Qwen · wuji2006
Params27.3B
Context256K
Q4_K_M16.5 GB
GE
gemma 4 26B A4B it qat heretic
Gemma · npario
Params25.2B
Context256K
Smallest14.2 GB
GE
Gemma-3-4B-It
Gemma · socrate-tech
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma-4-26B-A4B-It
Gemma · wolfliu
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
Qwen3.5-35B-A3B
Qwen · cmp-nct
Params34.7B
Context256K
Q4_K_M19.9 GB
GE
Gemma-3N-E4B-It
Gemma · BaybeDragon
Params6.87B
Context32K
Q4_K_M4.5 GB