Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TA
TAID LLM 1.5B
Taid · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MA
magnum v4 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
QW
Qwen3.8-27B
Qwen · bramburn
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · EnlistedGhost
Params8.19B
Context128K
Q4_K_M5.2 GB
Reasoning
QW
Chuluun Qwen2.5 72B v0.01
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
FA
Falcon3 1B Base
Falcon · bartowski
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
IN
Infracelestial 27B
Infracelestial · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
ReasoningRoleplayTool use
DO
Dots.Llm1.Inst
Dots · bartowski
Params143B
Context32K
Q4_K_M96.1 GB
GGUF
SC
MS Schisandra 22B v0.3
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
QW
Qwen3.8 27B Unleashed
Qwen · SwagMessiah100
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
NU
NuExtract 1.5 Smol
Nuextract · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
LY
MN Lyrebird 12B
Lyrebird · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HE
Helpingai3 Raw
Helpingai · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
TR
Trinity Large Preview
Trinity · arcee-ai
Params390B
Context—
Q4_K_M241.6 GB
GGUF
QW
Qwen3-8B
Qwen · cmp-nct
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
ZE
Zenith 4B
Zenith · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
QW
Qwen3.8-27B
Qwen · vs4vijay
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
DU
Dusk_Rainbow
Dusk · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 122B RpRMax v1
Qwen · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
KI
Kimi-K2-Instruct
Kimi · jobs-git
Params1030B
Context128K
Q4_K_M620.8 GB
CodingTool use
CO
Star Command R 32B v1
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · opensota
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · XythicK
Params21.8B
Context128K
Q4_K_M13.3 GB
ReasoningTool use
DA
DatacampLlama 3.1 8B
Datacampllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · Dinosaur-tothe-sky
Params34.7B
Context256K
Q4_K_M22.0 GB
ReasoningTool useVision
GE
Gemma 4 E4B It Heretic
Gemma · SassyDiffusion
Params7.46B
Context128K
Q4_K_M5.2 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · Hagwell
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
QW
Qwen3.6 27B Heretic
Qwen · SassyDiffusion
Params26.9B
Context256K
Q4_K_M17.4 GB
ReasoningTool useVision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · kolya32rus
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
HU
Cyber Tiel Coder 35B A3B
Huihui · ArkhAngelLifeJiggy
Params34.7B
Context256K
Q4_K_M22.1 GB
CodingReasoningTool use

Other quants

Keep browsing