Q3_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
SC
Schisandra
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
RA
X Ray_Alpha
Ray · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
DA
h2o-danube3-500m-chat
Danube · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
CY
Cydonia_Vistral
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5-4B
Qwen · Fix-AI
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwentile2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Miril Drone 2B 1
Miril · bartowski
Params4.63B
Context128K
Q4_K_M3.4 GB
EX
EXAONE 4.0 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
FA
Falcon3 3B Instruct Abliterated
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GE
Gemma 4 12B It Qat
Gemma · dahara1
Params11.9B
Context256K
Q4_K_M7.1 GB
IM
Impish_Mind_8B
Impish · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LF
LFM2 VL 1.6B
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
TA
UI TARS 7B SFT
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · bartowski
Params157M
Context2K
Q4_K_M0.1 GB
GE
gemma2 gutenberg 27B
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
BA
Baichuan M2 32B
Baichuan · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
BA
Bagel Dpo 8x7b v0.2
Bagel · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB