Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 5.2
GLM · sunshaohui
Params754B
Context1024K
Q4_K_M465.8 GB
ReasoningTool use
QW
Qwen3.6-27B
Qwen · MuVeraAI
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · PenAgent
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · DjeDjeB
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
QW
QwiVer3.6 35B A3B HF
Qwen · BlackRiverAI
Params35.5B
Context256K
Smallest12.6 GB
ReasoningTool useVision
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Qwen3.8-27B
Qwen · Oleksandrovych
Params26.9B
Context256K
Smallest12.8 GB
ReasoningTool use
BU
Buddy 2B v1
Buddy · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PH
Phi Line_14B
Phi · bartowski
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
GR
grok 2
Grok · oki692
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · stratalab-org
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
MI
Voxtral Small 24B 2507
Mistral · kukidevalml
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool useVision
FA
Fallen Command A 111B v1
Fallen · ClonedGizzards
Params111B
Context256K
Q4_K_M67.1 GB
GGUF
GE
Gemma-4-26B-A4B-It
Gemma · Kivichek
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
SU
MS Sunfall v0.7.0
Sunfall · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
RoleplayTool use
QW
Qwen3.5-9B
Qwen · madeofhuman
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
QW
Qwen2.5 Math 7B Instruct
Qwen · chiakelvin
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
HU
Hunyuan 1.8B Instruct
Hunyuan · Dzluck
Params1.79B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
EV
Evathene v1.3
Evathene · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
GE
Gemma-4-E4B-It
Gemma · armandosds
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · Fastiraz
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
MU
Muse Glimmer 30B
Muse · Hagwell
Params27.9B
Context128K
Smallest1.6 GB
ReasoningTool useVision
DE
Qwen2.5 32B
DeepSeek · viwo50
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
QW
Qwen3.6-27B
Qwen · thy025
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
ME
Medgemma-4B-It
Medgemma · Tavorish
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3.5 122B A10B Opus Reasoning MTP
Qwen · SixVolts
Params122B
Context256K
Smallest3.4 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · AlexRudy
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
Qwen3.6-27B
Qwen · twizted6665
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
LF
Lfm2.5-1.2B-Thinking
Lfm · EmogheneAkpomedaye
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · Blazestorm001
Params26.1B
Context256K
Smallest12.5 GB
ReasoningTool use

Other quants

Keep browsing