Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · ahmed-amedo
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3-Vl-30B-A3B-Thinking
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningVision
GE
gemma 4 E4B it heretic QAT
Gemma · SC117
Params7.46B
Context128K
Smallest4.3 GB
CodingVision
GR
grok 2
Grok · unsloth
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
Vision
QW
Qwen3.8-27B
Qwen · aiartorious
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3-8B-128K
Qwen · unsloth
Params8.19B
Context128K
Q4_K_M5.0 GB
GGUF
MI
Mistral-Large-4-1T-A52B-DSpark
Mistral · unsloth
Params1050B
Context1024K
Smallest2.2 GB
ReasoningTool useVision
OL
Olmo-3-7B-Think
OLMo · unsloth
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
QW
Swift Qwen3.8 27B Uncensored Dynamic MTP
Qwen · ajgazin
Params461M
Context256K
Smallest9.8 GB
Vision
MU
Muse Glimmer 30B
Muse · AaryanK
Params28B
Context128K
Q4_K_M15.9 GB
Vision
GR
Granite-4.1-8B
Granite · unsloth
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen3.8-27B
Qwen · haybar4k
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
SE
Seed-Coder-8B-Reasoning
Seed · unsloth
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning
MI
Minimax-M2.7
Minimax · unsloth
Params230B
Context192K
Q4_K_M140.2 GB
GGUF
QW
Qwen3.8-27B
Qwen · Weirdo333
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
MI
Devstral-Small-2505
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.8-27B
Qwen · igroc656
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.8-27B
Qwen · xrachelburns
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
MI
Mimo-V2.5-Pro
Mimo · unsloth
Params1020B
Context1024K
Q4_K_M629.6 GB
Coding
QW
Qwen3.8-27B
Qwen · Shishkipiski
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · yachiyo8080
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
MI
Minimax-M2.1
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
CO
Cosmos-Reason1-7B
Cosmos · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
KI
Kimi-K2.6
Kimi · unsloth
Params1030B
Context256K
Smallest340.5 GB
Vision
QW
Qwenmodel1st
Qwen · atypical-chai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.8-27B
Qwen · Kaktus4048
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision

Other quants

Keep browsing