Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5-Omni-7B
Qwen · Sci-fi-vy
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
FU
functionary small v3.1
Functionary · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
VE
Q2.5 Veltha 14B 0.5
Veltha · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
dnotitia_Smoothie Qwen3 1.7B
Qwen · Alcoft
Params1.72B
Context40K
Q4_K_M1.0 GB
Reasoning
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
SI
simplescaling s1.1 32B
bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
NA
Nanbeige4 3B Thinking 2511
Nanbeige · bartowski
Params3.93B
Context64K
Q4_K_M2.4 GB
Reasoning
FO
ReadyArt Forgotten Safeword 70B 3.6
Forgotten · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
CA
Cassiopeia 70B
Cassiopeia · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
JA
Jan Nano 128k
Jan · bartowski
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
FI
v6 Finch 14B HF
Finch · bartowski
Params14.1B
Context1024K
Q4_K_M8.8 GB
GGUF
SA
Steelskull L3.3 San Mai R1 70b
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 27B Unleashed
Qwen · Prolokkmn
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
MI
BlackSheep Mistral RP 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
MiroThinker v1.0 30B
Mirothinker · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
LL
MathCoder2 Llama 3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Coding
ST
Step 3.7 Flash
Step · bartowski
Params199B
Context256K
Q4_K_M121.6 GB
ReasoningTool useVision
LL
Llama 3.2 Korean Bllossom 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GL
GLM 5.3 Flash
GLM · muterornament
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
QW
Qwen3.5 9B Heretic
Qwen · SassyDiffusion
Params8.95B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
TI
TinySwallow 1.5B Instruct
Tinyswallow · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
QW
Rombo LLM V3.0 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ReasoningTool use
CY
cybertron v4 qw7B UNAMGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
SA
TheSkullery L3.3 exp unnamed model 70b v0.5
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning

Other quants

Keep browsing