Q3_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.
SI
simplescaling s1 32B
bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · SassyDiffusion
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
outsourc e Qwen3.8 27B Unleashed
Qwen · jaromer
Params27B
Context256K
Q4_K_M16.5 GB
DA
Dans DangerousWinds V1.0.0 7b
Dans · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Qwen_Qwen3 0.6B
Qwen · Alcoft
Params752M
Context40K
Q4_K_M0.5 GB
QW
Qwen3 VL 4B Thinking
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
NE
AceReason Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
BL
G2 9B Blackout R1
Blackout · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · cecloud33
Params8.19B
Context128K
Q4_K_M5.0 GB
XL
xLAM 8x22b R
Xlam · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
LL
Llama 3.1 8B Open SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GI
Gilgamesh 72B
Gilgamesh · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
Miscii 14b 1225
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
MiniMax H3
Minimax · myhuggingbb
Params20.1B
Context—
Q4_K_M18.2 GB
QW
QwQ LCoT 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
DeepSeek V3.1 Terminus
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
EL
Eleusis 12B
Eleusis · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Replete Coder Qwen2 1.5b
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
CE
Celestial Harmony 14b v1.0 Experimental 1016
Celestial · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
RE
ozone ai Reverb 7b
Reverb · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
KA
KAT Dev
Kat · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
SY
Synthia S1 27b
Synthia · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
DH
Dhanishtha 2.0 Preview 0825
Dhanishtha · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
TE
Tessa T1 7B
Tessa · bartowski
Params7.62B
Context117K
Q4_K_M4.7 GB
QW
Qwen3.8-27B
Qwen · LeeMantras
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
ST
Steelskull L3.3 Mokume Gane R1 70b
Steelskull · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB