Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-4B
Qwen · autoocrat0413
Params4.02B
Context40K
Smallest2.5 GB
ReasoningTool use
QW
QwQ 32B
Qwen · kolosal
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
QW
Qwen3-0.6B
Qwen · kolosal
Params596M
Context40K
Smallest0.4 GB
ReasoningTool use
QW
Qwen3.5-9B
Qwen · raz-org
Params8.95B
Context256K
Smallest6.0 GB
ReasoningTool useVision
QW
Qwen3-1.7B
Qwen · kolosal
Params1.72B
Context40K
Smallest1.1 GB
ReasoningTool use
QW
Qwen3-30B-A3B
Qwen · kolosal
Params30.5B
Context40K
Smallest17.7 GB
ReasoningTool use
QW
Qwen3.5-0.8B
Qwen · XpressAI
Params918M
Context256K
Smallest0.7 GB
ReasoningTool use
GE
Gemma-4-12B-It
Gemma · mangaba-ai
Params11.9B
Context256K
Smallest7.4 GB
ReasoningTool use
QW
Qwen3-8B-128K
Qwen · kolosal
Params8.19B
Context128K
Smallest5.2 GB
ReasoningTool use
QW
Qwen3-4B-128K
Qwen · kolosal
Params4.02B
Context128K
Smallest2.5 GB
ReasoningTool use
QW
Qwen3.5-27B
Qwen · andypotato
Params26.9B
Context256K
Smallest17.6 GB
ReasoningTool use
GL
GLM 4.6
GLM · moxin-org
Params357B
Context198K
Smallest219.4 GB
ReasoningTool use
FL
flux2
Flux · vtswcbyy
Params3.88B
Context—
Smallest2.5 GB
GGUF
GE
Gemma-3-4B-It
Gemma · Fedir-Ilina
Params3.88B
Context128K
Smallest2.5 GB
Vision
GE
gemma 4 12B it qat
Gemma · alekshandru
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
GE
gemma 3 4b it unslop GRPO v3
Gemma · electroglyph
Params3.88B
Context128K
Smallest2.5 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · ArtFix0
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision
GE
submission 006 gemma4 12b routed t01
Gemma · keenansamway
Params11.9B
Context256K
Smallest7.4 GB
ReasoningTool use
QW
Qwen3.5-27B
Qwen · Aa15583
Params26.9B
Context256K
Smallest17.6 GB
ReasoningTool useVision
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · aarontmaher
Params755M
Context1024K
Smallest0.0 GB
GGUF
SY
SynapseData
Synapsedata · Birdsey
Params11.9B
Context128K
Q4_K_M3.1 GB
ReasoningTool use
QW
Qwen3.6-27B
Qwen · EnclaveHost
Params26.9B
Context256K
Smallest17.6 GB
ReasoningTool use
CL
CLIP
Clip · nguoidoncui
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
GE
whispall gemma e2b qat
Gemma · YvesStudioSmelt
Params4.63B
Context128K
Smallest2.6 GB
ReasoningTool use
QW
qwen llm
Qwen · marsmarketing
Params27.3B
Context256K
Smallest17.9 GB
ReasoningTool use
BA
baichuan inc Baichuan M3 235B
Baichuan · spicyneuron
Params235B
Context40K
Smallest134.1 GB
ReasoningTool use
MU
mus ai
Mus · mazmurlo
Params30.7B
Context256K
Smallest18.8 GB
ReasoningTool useVision
QW
Qwen3.6-27B
Qwen · yorickr
Params27.3B
Context256K
Smallest17.9 GB
ReasoningTool useVision
FL
flint cpu opt
Flint · HelloSun
Params39.8B
Context256K
Smallest25.1 GB
ReasoningTool use
OR
Ornith 1.0 35B UD Q4 K XL MTP
Ornith · KaviarLabs
Params35.5B
Context256K
Smallest22.9 GB
ReasoningTool use

Other quants

Keep browsing