Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Dongfangshuo Qwen3.8 Flash Next NSFW
Qwen · dongfangshuo
Params177B
Context256K
Smallest69.7 GB
RoleplayVision
GE
gemma 4 12B it
Gemma · AtomicChat
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 4 E4B it
Gemma · AtomicChat
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GL
Glm-4.6V
GLM · unsloth
Params107B
Context128K
Q4_K_M70.6 GB
Vision
MI
Ministral-3-3B-Instruct-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · freakyskittle
Params177B
Context256K
Q4_K_M2.6 GB
Vision
QW
SpaceTimee/Suri-Qwen-3.8-27B-Uncensored
Qwen · SpaceTimee
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
GGUF
QW
Qwen3-Vl-32B-Instruct
Qwen · unsloth
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · unsloth
Params23B
Context198K
Q4_K_M14.1 GB
GGUF
QW
Qwen3-Vl-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
MI
Mistral-Small-4-119B-2603
Mistral · unsloth
Params119B
Context1024K
Q4_K_M73.8 GB
Vision
LF
Lfm2.5-8B-A1B
Lfm · unsloth
Params8.47B
Context125K
Q4_K_M5.3 GB
GGUF
LF
Lfm2.5-Vl-3B
Lfm · unsloth
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
MI
MiniCPM-V-4.7-35B-A3B-Uncensored
MiniCPM · gbuzhf
Params34.7B
Context256K
Smallest11.9 GB
Vision
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params397B
Context256K
Q4_K_M244.1 GB
Vision
MI
Ministral-3-8B-Instruct-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Atomic Chat / Qwen3.5 9B
Qwen · AtomicChat
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
GGUF
QW
Atomic Chat / Qwen3.5 4B
Qwen · AtomicChat
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
FL
flux 3 image klein pup
Flux · unsloth
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
LL
Llama-3.1-8B-Instruct
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
KI
Kimi-K2-Instruct
Kimi · unsloth
Params1030B
Context128K
Q4_K_M620.8 GB
Coding
QW
Qwen2.5-Omni-7B
Qwen · unsloth
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
MI
Ministral-3-14B-Instruct-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.6 GB
Vision
TE
Tessera-27B-B-CJK
Tessera · ZelligeAI
Params27.3B
Context256K
Smallest13.1 GB
Vision
ME
Medgemma-1.5-4B-It
Medgemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision

Other quants

Keep browsing