Q4_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwopus3.8 27B
Qwen · nom666
Params27.3B
Context256K
Q4_K_M16.8 GB
OR
Ornith 1.0 35B
Ornith · Hagwell
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen3.5-4B
Qwen · MdSajjadurRahaman
Params4.21B
Context256K
Q4_K_M2.7 GB
NO
North Mini Code 1.0 Uncensored Heretic
North · OS-Software
Params30.5B
Context488K
Smallest14.3 GB
GE
Gemma-4-E2B-It
Gemma · P2Enjoy
Params4.65B
Context128K
Smallest3.2 GB
GE
Gemma-4-E4B-It
Gemma · qiufeng001
Params7.52B
Context128K
Q4_K_M5.0 GB
GL
GLM 4.7 PRISM Unsloth
GLM · AliceThirty
Params353B
Context198K
Smallest82.7 GB
GE
gemma 4 12B it qat
Gemma · Pq234
Params11.9B
Context256K
Smallest0.3 GB
QW
Qwen3.5-4B
Qwen · nutyon1
Params4.33B
Context256K
Q4_K_M2.8 GB
NA
Nanbeige4.2 3B
Nanbeige · Andgihat
Params4.17B
Context256K
Smallest2.6 GB
QW
Qwen3 Next REAP 15B A3B Thinking
Qwen · lovedheart
Params16.8B
Context256K
Smallest11.7 GB
GL
GLM 5.3 Flash
GLM · Ihnenko
Params321B
Context1024K
Smallest93.1 GB
GE
gen myanmar 4 E2B
Gemma · BaybeDragon
Params4.65B
Context128K
Q4_K_M3.1 GB
QW
gen llm qwen38
Qwen · josecjr23232
Params27.3B
Context256K
Smallest17.4 GB
CH
chandra ocr 2 ggufs
Chandra · Yashp2003
Params4.96B
Context256K
Smallest2.6 GB
GL
Neve Strata 4 30B
GLM · NeveAI
Params29.9B
Context198K
Smallest17.5 GB
QW
Qwen3.5-4B
Qwen · dev-vinod
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma-4-12B-It
Gemma · vickersdp
Params11.9B
Context256K
Q4_K_M7.1 GB
GL
GLM 5.3 Flash
GLM · moixx
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3.6 27B abliterated v2
Qwen · groxaxo
Params26.9B
Context256K
Smallest11.4 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · Nil626yhh
Params284B
Context1024K
Smallest10.9 GB
AV
averon1.1
Averon · bikesa
Params35.5B
Context256K
Smallest0.9 GB
GL
GLM 5.3 Flash
GLM · zurichquants
Params321B
Context1024K
Smallest93.1 GB
GE
gemma 4 E4B it qat
Gemma · manojbillionaire123
Params7.46B
Context128K
Smallest0.1 GB
QW
Qwen3.5-2B
Qwen · NikitaLazarev
Params1.88B
Context256K
Smallest1.4 GB
DE
Deepseek-V4-Flash
DeepSeek · poppingstar
Params284B
Context1024K
Smallest82.5 GB
KI
Kimi-K3
Kimi · Amynnnn
Params2780B
Context1024K
Smallest594.0 GB
SH
Shadow-Siren-26B-A4B
Shadow · KaviarLabs
Params25.2B
Context256K
Q4_K_M16.9 GB
LT
ltx2.3 toolkit
Ltx · Cybronya
Params11.8B
Context128K
Smallest7.4 GB
GL
compressed backup GLM 5.2
GLM · vinayakkamboj
Params754B
Context1024K
Q4_K_M465.8 GB