Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek-V4-Flash
DeepSeek · tHEsadad
Params284B
Context1024K
Smallest82.5 GB
ReasoningTool use
QW
Qwen3.8 27B Unleashed Q3XL mirror
Qwen · chewbacca321
Params27.3B
Context256K
Smallest13.2 GB
ReasoningTool useVision
PH
Phi 4 Mini Instruct
Phi · lucasxie2025
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest16.6 GB
ReasoningTool useVision
IN
TML Inkling
Inkling · Pq234
Params947B
Context1024K
Smallest270.2 GB
ReasoningTool useVision
PH
Phi 3.1 mini 4k instruct
Phi · fjguodong
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
KI
Kimi-K2-Thinking
Kimi · moxin-org
Params1030B
Context256K
Smallest243.6 GB
ReasoningTool use
QW
Qwen3.6 27B MTP TENSORS ONLY
Qwen · tooltd
Params425M
Context—
Smallest0.2 GB
GGUF
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
ReasoningTool useVision
GE
Testing
Gemma · Bax-uzi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · Ai2-Alliance
Params48.9B
Context256K
Smallest22.9 GB
CodingTool use
QW
Qwen3.5-0.8B
Qwen · manojbillionaire123
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
OR
Ornith-1.5-35B
Ornith · yukimakura
Params34.7B
Context256K
Smallest16.8 GB
ReasoningTool use
QW
Qwen3.6 27B Omnimerge v4 MTP
Qwen · fribourgquant
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
MI
minmax
Minmax · Rob1221rib
Params20.1B
Context—
Q4_K_M11.5 GB
GGUF
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest366.8 GB
ReasoningTool use
QW
Qwen3.5-4B
Qwen · Manojb
Params4.21B
Context256K
Smallest2.4 GB
ReasoningTool useVision
QW
Qwen3.8-27B-Uncensored
Qwen · Gavvvin
Params26.9B
Context256K
Smallest11.8 GB
ReasoningTool useVision
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest14.4 GB
ReasoningTool useVision
QW
qwen next gguf q3xl
Qwen · Jakelovesyourmom
Params79.7B
Context256K
Smallest36.3 GB
Tool use
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest17.3 GB
ReasoningTool useVision
QW
Qwen3.6-27B
Qwen · Evilcarbon
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · Nielk38
Params27.3B
Context256K
Smallest13.1 GB
ReasoningTool use
QW
Qwen3.6-27B
Qwen · dskvngsfdjlksn
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · DOMINICDA
Params9.2B
Context256K
Q4_K_M5.9 GB
ReasoningTool useVision
15
15313
08443u0
Params11.8B
Context256K
Smallest2.8 GB
GGUF
TE
textonly
Textonly · cccucumber
Params29.9B
Context198K
Smallest13.8 GB
ReasoningTool use
ME
Medgemma-1.5-4B-It
Medgemma · Aditya-Sivanandan
Params3.88B
Context128K
Smallest2.2 GB
GGUF
QW
Qwen3.5-4B
Qwen · walter-bd
Params4.21B
Context256K
Smallest2.4 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · ArtFix0
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision

Other quants

Keep browsing