Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
OREAL 32B
InternLM · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
ST
StarDust 12b v2
Stardust · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3.5-9B
Qwen · Xlnk
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
TR
Trinity Large TrueBase
Trinity · bartowski
Params399B
Context8K
Q4_K_M241.6 GB
GGUF
HE
Hercules Stheno v1
Hercules · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Art v0 3B
Art · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
PR
Nohobby L3.3 Prikol 70B v0.4
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BE
Beeper King 22B
Beeper · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
QW
Qwen3.6-27B
Qwen · cmp-nct
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen2.5-1.5B-Open-R1-GRPO
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
QW
Chuluun Qwen2.5 72B v0.08
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · Alcoft
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
GE
Gemma 2 27b Chatml
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
SK
Skyfall 39B V1A WS
Skyfall · bartowski
Params39B
Context128K
Q4_K_M23.4 GB
Tool use
LL
Llama-3.2-1B-Instruct
Llama · RekcyDecky
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · cartoon45
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
LI
inclusionAI/Ling-1T
Ling · bartowski
Params1000B
Context32K
Q4_K_M608.4 GB
ReasoningTool use
AT
Athene V2 Agent
Athene · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
GE
gemma-4-E2B-it-ultra-uncensored-heretic
Gemma · JMingo
Params4.63B
Context128K
Q4_K_M3.1 GB
ReasoningTool use
PA
Pantheon Rp 1.6 12b Nemo Kto
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
DA
Dans DangerousWinds V1.1.0 12b
Dans · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GE
Gemma 2b Aps It
Gemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
EL
EleMo V2 Base
Elemo · Earlychildhoodeducation
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
MI
Q2.5 MS Mistoria 72b v2
Mistoria · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
YU
YuLan Mini
Yulan · diskrot
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
LI
ozone research 0x lite
Lite · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
NE
L3.1 nemotron sunfall v0.7.0
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
JE
Jedi 7B 1080p
Jedi · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DU
Duet Minitron8b v0.5
Duet · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF

Other quants

Keep browsing