Q3_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.
CE
L3-8B-Celeste-V1.2
Celeste · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
gemma-4-E4B-it-heretic-japanese-only
Gemma · JMingo
Params4.56B
Context128K
Q4_K_M3.0 GB
LL
Llama 3.2 3B Instruct
Llama · aratadev
Params3.61B
Context128K
Q4_K_M2.2 GB
QW
Qwen3.8-27B
Qwen · DonnyFlo85
Params27.3B
Context256K
Q4_K_M16.5 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · ipsarkar
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 2 2b It
Gemma · Kismi
Params2.61B
Context8K
Q4_K_M1.7 GB
GR
Granite-4.1-30B
Granite · jamiefutch
Params28.9B
Context128K
Q4_K_M17.5 GB
AR
Arcee-Nova
Arcee · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GE
Gemma-3-1B-It
Gemma · shehrozrafaqat
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen3.8 27B Unleashed
Qwen · AleaiactaEst1
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5-0.8B
Qwen · Xlnk
Params752M
Context256K
Q4_K_M0.5 GB
BE
Behemoth 123B v2.1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
QW
Qwen3.8-27B
Qwen · fyqfy
Params27.3B
Context256K
Q4_K_M16.5 GB
TH
Theia 21B v1
Theia · bartowski
Params20.4B
Context1000K
Q4_K_M12.4 GB
PR
Prismatic 12b v0.1 Experimental 1115
Prismatic · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
The Omega Abomination Gemma3 12B v1.0
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.6 35B REAP MTP UD GGUF Collection
Qwen · JZC973
Params25.7B
Context256K
Smallest10.5 GB
QW
Qwen3.5-0.8B
Qwen · ente-ai
Params752M
Context256K
Q4_K_M0.5 GB
CO
Cogito-671B-V2.1
Cogito · unsloth
Params671B
Context160K
Q4_K_M405.4 GB
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Qwen3.5-35B-A3B
Qwen · Paul-Wang
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · stratalab-org
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5-2B
Qwen · Xlnk
Params1.88B
Context256K
Q4_K_M1.3 GB
NY
G2 DA Nyxora 27b V2
Nyxora · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Robert-Finance
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Gemma-4-12B-It
Gemma · sebidev
Params11.9B
Context256K
Q4_K_M7.1 GB
MI
Mistral Crab SFT
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.6-35B-A3B
Qwen · Deepdive404
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen3-4B
Qwen · XythicK
Params4.02B
Context40K
Q4_K_M2.5 GB
MI
MiniMax H3
Minimax · JRay0421
Params20.1B
Context—
Q4_K_M18.2 GB