Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · karnodel
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.5-27B
Qwen · ysy1949
Params26.9B
Context256K
Q4_K_M16.7 GB
ReasoningTool useVision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · Heppy94
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
QW
Qwen3.6-35B-A3B
Qwen · kingDerf
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
MU
Muse Glimmer 30B
Muse · atrezonator
Params27.9B
Context128K
Smallest1.6 GB
Vision
QW
Qwen3.5-2B
Qwen · ente-ai
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
05
052368
0145821A
Params11.9B
Context256K
Smallest6.7 GB
ReasoningTool useVision
GE
Gemma-4-26B-A4B-It
Gemma · ygoayu
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
GE
Gemma 4 E4B IT QAT
Gemma · pleasen
Params7.46B
Context128K
Smallest3.2 GB
ReasoningTool useVision
GE
gemma 4 26B A4B it qat
Gemma · ShaunGves
Params25.2B
Context128K
Smallest0.3 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next
Qwen · Vardaan97
Params177B
Context256K
Smallest136.9 GB
ReasoningTool useVision
QW
shisa v2.1 qwen3 8b UD japanese imatrix
Qwen · SiliconJelly
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MI
Minimax-M2.7
Minimax · SickRick
Params229B
Context192K
Q4_K_M140.2 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · AetherKelly00
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision
KI
Kimi-K2.7-Code
Kimi · NullVoider
Params1030B
Context256K
Smallest303.9 GB
CodingReasoningTool use
QW
Qwen2.5-Omni-7B
Qwen · findingispointless
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
GR
grok 2
Grok · cooonhwe
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
QW
Qwen3.5-0.8B
Qwen · manojbillionaire123
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · Fastiraz
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
QW
Qwen3.5-0.8B
Qwen · Athithya117
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GL
GLM 5.2
GLM · sunshaohui
Params754B
Context1024K
Q4_K_M465.8 GB
ReasoningTool use
QW
Qwen3.6-27B
Qwen · MuVeraAI
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · PenAgent
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
LA
Laguna XS 2.1 APEX
Laguna · gbuzhf
Params33.4B
Context256K
Smallest12.9 GB
ReasoningTool use
QW
Qwen3 Next REAP 30B A3B Instruct
Qwen · lovedheart
Params31.3B
Context256K
Smallest13.4 GB
Tool use
QW
Qwen3.6 27B Claude Opus Reasoning Distilled UD Q4 K XL
Qwen · DAXZEIT
Params26.9B
Context256K
Smallest18.2 GB
ReasoningTool use
QW
Qwen3.6-35B-A3B
Qwen · DjeDjeB
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
MU
Muse Glimmer 30B
Muse · ml-resources
Params27.9B
Context128K
Q4_K_M1.6 GB
ReasoningTool useVision
QW
QwiVer3.6 35B A3B HF
Qwen · BlackRiverAI
Params35.5B
Context256K
Smallest12.6 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next
Qwen · Lucebox
Params177B
Context256K
Smallest2.8 GB
ReasoningTool use

Other quants

Keep browsing