Q3_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8-27B
Qwen · FenomAI
Params27.3B
Context256K
Q4_K_M17.1 GB
LL
Llama3.1 8b_codeio_pp
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
EN
Endurance 100B v1.1
Endurance · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
BE
Behemoth ReduX 123B v1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M9.2 GB
QW
Lancer Coder Next abliterated
Qwen · Rixf123
Params79.7B
Context256K
Q4_K_M48.6 GB
QW
FlashModel Qwen3.5 9B
Qwen · flashback2k
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Meta Llama 3.1 8B Instruct
Llama · starshina3003
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
Trinity
Trinity · arcee-ai
Params399B
Context256K
Q4_K_M241.8 GB
GL
GLM 5.2 ewaste edition
GLM · SixVolts
Params754B
Context1024K
Smallest243.6 GB
LL
Llama3 Crab DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
UL
Ultra Instruct 12B
Ultra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Tiger Gemma 9B v2
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
TU
Tulu MathLingo 8B
Tulu · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
AR
Arcee Blitz
Arcee · arcee-ai
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mimo-Vl-7B-Rl
Mimo · akpsahan
Params7.62B
Context125K
Q4_K_M4.7 GB
AR
Arch Function 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
MiroThinker v1.0 72B
Mirothinker · bartowski
Params72.7B
Context256K
Q4_K_M47.4 GB
QW
Qwen3 8B
Qwen · EnlistedGhost
Params8.19B
Context40K
Q4_K_M5.3 GB
NE
Nemotron 3.5 Bolt E4B Artemis
Nemotron · turintech
Params7.52B
Context64K
Smallest3.7 GB
AB
L3.1 Ablaze Vulca v0.1 8B
Ablaze · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5-9B
Qwen · duolaf
Params8.95B
Context256K
Q4_K_M5.7 GB
VI
Virtuoso Large
Virtuoso · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GE
Gemma-3-27B-It
Gemma · tripolskypetr
Params27B
Context128K
Q4_K_M16.5 GB
SE
Seeker 9b
Seeker · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
SubtleOne Qwen2.5 32b Erudite Writer
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
MI
Tess R1 Ballad Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
TH
Theia 21B V2A
Theia · bartowski
Params20.4B
Context1000K
Q4_K_M12.4 GB
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB