Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.6-27B
Qwen · orion-labs
Params26.9B
Context256K
Q4_K_M16.8 GB
GR
granite 4.1 30b DASHQ Q2
Granite · jkim96
Params28.9B
Context128K
Smallest8.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · glxiexie
Params284B
Context1024K
Smallest10.9 GB
QW
Qwen3.5 122B A10B Heretic
Qwen · SassyDiffusion
Params122B
Context256K
Smallest41.8 GB
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · moxin-org
Params235B
Context256K
Smallest89.0 GB
QW
Qwen3.6-27B
Qwen · poppingstar
Params27.3B
Context256K
Q4_K_M17.1 GB
DE
Deepseek-V4-Flash
DeepSeek · tHEsadad
Params284B
Context1024K
Smallest82.5 GB
DE
DeepSeek V4 Flash 0731 REAP W
DeepSeek · mmnga-o
Params155B
Context1024K
Smallest55.0 GB
IN
TML Inkling
Inkling · Pq234
Params947B
Context1024K
Smallest270.2 GB
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest11.2 GB
KI
Kimi-K2-Thinking
Kimi · moxin-org
Params1030B
Context256K
Smallest243.6 GB
QW
Qwen3.6-35B-A3B
Qwen · eodus
Params83.1B
Context256K
Smallest12.0 GB
QW
Qwen3.8 Flash Next
Qwen · Nielk38
Params177B
Context256K
Smallest78.9 GB
GE
Gemma-4-E2B-It
Gemma · Charles322
Params4.65B
Context128K
Smallest2.3 GB
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · Ai2-Alliance
Params48.9B
Context256K
Smallest22.9 GB
MI
Minimax-M2.1
Minimax · moxin-org
Params229B
Context192K
Smallest84.9 GB
QW
Qwen3.5-0.8B
Qwen · manojbillionaire123
Params752M
Context256K
Q4_K_M0.5 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest284.1 GB
MI
minmax
Minmax · Rob1221rib
Params20.1B
Context—
Q4_K_M11.5 GB
KI
Kimi-K2.6
Kimi · Shadiamr
Params1030B
Context256K
Smallest340.5 GB
GL
GLM 4.7 PRISM Unsloth
GLM · the-fall-of-man
Params353B
Context198K
Smallest82.7 GB
KI
Kimi-K3
Kimi · mmnga-o
Params1420B
Context1024K
Smallest326.9 GB
QW
Qwen3.8 Flash Next
Qwen · webmp3
Params177B
Context256K
Smallest63.5 GB
QW
Qwen3.6-27B
Qwen · Evilcarbon
Params26.9B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6-27B
Qwen · dskvngsfdjlksn
Params27.3B
Context256K
Q4_K_M17.1 GB
QW
Qwen3.5-9B
Qwen · DOMINICDA
Params9.2B
Context256K
Q4_K_M5.9 GB
QW
Qwen3.5-4B
Qwen · sinatras
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
H LLM LOCAL
Llm · sdasdawq234
Params7.5B
Context128K
Smallest3.7 GB
DE
Deepseek-R1-0528
DeepSeek · bobchenyx
Params671B
Context160K
Smallest226.3 GB
QW
Qwen3.5-2B
Qwen · sinatras
Params1.88B
Context256K
Q4_K_M1.3 GB