Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
open thoughts OpenThinker 32B
Openthinker · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
IN
Intellect-2
Intellect · unsloth
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
SE
T Search
Search · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
ReasoningTool useVision
CA
Cathallama 70B
Cathallama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 27B Writer
Qwen · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
ReasoningTool use
P1
P1 VL 235B A22B
axi0mX
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool useVision
GE
GEMMA SUTRA
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3-14B
Qwen · cmp-nct
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
BI
allura org Bigger Body 8b
Bigger · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 3 Starshine 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Qwen3.5-9B
Qwen · cmp-nct
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
MI
Ministral 3 8B Instruct 2512
Mistral · EnlistedGhost
Params8.49B
Context256K
Smallest3.9 GB
Vision
CY
Cydonia 22B v1.1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
LL
Openbuddy Llama3.3 70b v24.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LF
LFM2.5-24B-A2B-Preview
Lfm · TechnoBaptist
Params24B
Context128K
Smallest7.5 GB
ReasoningTool use
QW
Qwen3.6-27B
Qwen · AtomicChat
Params461M
Context256K
Smallest16.8 GB
Vision
QW
Swift Qwen3.8 27B Abliterated
Qwen · andrewting
Params27.3B
Context256K
Smallest13.2 GB
ReasoningTool useVision
QW
Soob3123_Amoral Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Rombo LLM V3.1 QWQ 32b
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
LL
Llama-3.3-70B-Instruct
Llama · axana-labs
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
AS
L3.1 MS Astoria 70b v2
Astoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 2B
Qwen · dahara1
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
NE
Nex N2 Mini
Nex · adamm-hf
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · Aydge
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · bartowski
Params8B
Context1048K
Q4_K_M4.9 GB
GGUF
IN
Internvl3-38B-Instruct
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool useVision
HU
HuatuoGPT O1 72B
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Reasoning
RE
Reka Flash 3.1
Reka · bartowski
Params20.9B
Context96K
Q4_K_M13.6 GB
GGUF
QW
Qwen3.8-27B
Qwen · Didkk
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision

Other quants

Keep browsing