Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6-27B
Qwen · Distillio
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
GE
gemma 4 E4B it heretic QAT
Gemma · yunlou2026
Params7.46B
Context128K
Smallest4.3 GB
CodingReasoningTool use
GL
GLM 5.3 Flash
GLM · CoboSan
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
GE
Gemma-4-26B-A4B-It
Gemma · rahul-shukla
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · XpressAI
Params34.7B
Context256K
Smallest22.4 GB
ReasoningTool use
GE
Gemma-3N-E2B-It
Gemma · tripolskypetr
Params4.46B
Context32K
Q4_K_M2.8 GB
Vision
CO
comfyui models
Comfyui · aka7774
Params508M
Context2K
Q4_K_M4.8 GB
GGUF
QW
Qwen3 Next REAP 40B A3B Instruct
Qwen · lovedheart
Params41B
Context256K
Smallest19.1 GB
Tool use
QW
Qwen3.5 4B QD
Qwen · QuaduxIT
Params4.33B
Context256K
Smallest2.1 GB
ReasoningTool useVision
GE
Gemma-4-E2B-It-Japanese
Gemma · JMingo
Params2.34B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
LL
Llama-3.2-3B-Instruct
Llama · goingmerry91
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen3.6-35B-A3B
Qwen · Fastiraz
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
GE
LaToucheCarre Texte L Gemma 4 E2B QAT UD Q4 K XL FR EN
Gemma · LaToucheCarre
Params3.54B
Context128K
Smallest2.0 GB
ReasoningTool use
NE
Nemotron-3.5-Super-VL-120B-A12B
Nemotron · inference-snaps
Params124B
Context1024K
Smallest77.7 GB
ReasoningTool useVision
GE
gemma 4 E4B it heretic QAT
Gemma · guga112
Params7.46B
Context128K
Smallest4.3 GB
CodingReasoningTool use
GE
gemma 4 12B it qat
Gemma · Mer0vin8ian
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
GE
gemma 4 E2B it qat
Gemma · erenyeager-1
Params4.63B
Context128K
Smallest2.2 GB
ReasoningTool useVision
GE
gemma 4 12B it qat
Gemma · Jhustle44
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
QW
Qwen3 Coder 30B A3B Instruct 480B Distill V2 Fp32
Qwen · rodrigomt
Params30.5B
Context256K
Smallest13.8 GB
CodingTool use
LL
Llama-3.1-8B-Instruct
Llama · mohammedqarnuon
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GL
GLM 5.3 Flash
GLM · lazywold
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · recursechat
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ER
Ernie-4.5-0.3B-Pt
Ernie · Dc15er
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
GE
Gemma 4 Gembrain 31B
Gemma · phruut
Params30.7B
Context256K
Smallest18.8 GB
ReasoningRoleplayTool use
GE
gemma 4 12B it qat UD Q4 K XL 5GB
Gemma · inference-snaps
Params11.9B
Context256K
Smallest6.7 GB
ReasoningTool use
GE
Gemma 4 E4B
Gemma · Adr1ans1t0
Params7.46B
Context128K
Smallest0.1 GB
ReasoningTool useVision
GE
Gemma-4-E4B-It
Gemma · Arabic250
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · Nil626yhh
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · bogservi
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · ashuaria
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision

Other quants

Keep browsing