Q4_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
TA
tally models
Tally · Syrianapps
Params4.46B
Context32K
Smallest3.8 GB
QW
slim rpcache unsloth qwen3 coder 30b a3b udq4xl
Qwen · Zambizi
Params30.5B
Context256K
Smallest17.7 GB
QW
Qwen3.6-27B
Qwen · mangaba-ai
Params26.9B
Context256K
Smallest17.6 GB
GE
Gemma 4 broken quant
Gemma · espen96
Params25.2B
Context256K
Smallest17.1 GB
QW
kuza qwen 3.5 4b
Qwen · kuzaai
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
gemma 4 26B A4B it oQ8e
Gemma · ReconOut
Params25.3B
Context256K
Smallest0.0 GB
QW
qwen3 27b q4kxl
Qwen · Jakelovesyourmom
Params27.3B
Context256K
Smallest17.6 GB
QW
Qwen3.6-27B
Qwen · EnclaveHost
Params27.3B
Context256K
Smallest17.9 GB
QW
Qwen3.5-9B
Qwen · mangaba-ai
Params8.95B
Context256K
Smallest6.0 GB
QW
CyberGuard Model
Qwen · Soham308
Params4.21B
Context256K
Smallest2.9 GB
GE
submission 004 gemma4 12b inprocess
Gemma · keenansamway
Params11.9B
Context256K
Smallest7.4 GB
QW
Qwen3.5-9B
Qwen · EnclaveHost
Params8.95B
Context256K
Smallest6.0 GB
QW
Qwen3-30B-A3B
Qwen · christopherthompson81
Params30.5B
Context40K
Smallest17.7 GB
QW
Qwen3.6-27B
Qwen · BumbaBot
Params26.9B
Context256K
Smallest17.6 GB
QW
Qwen3-14B
Qwen · kolosal
Params14.8B
Context40K
Smallest9.2 GB
MY
myqwen
Myqwen · Minhle2303
Params44M
Context—
Smallest0.2 GB
LE
Lens Turbo
Lens · szwagros
Params20.9B
Context128K
Smallest11.9 GB
KU
kuza dynamic
Kuza · kuzaai
Params4.63B
Context512
Smallest4.5 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · myhuggingbb
Params284B
Context1024K
Smallest155.1 GB
QW
Qwen3-32B-128K
Qwen · kolosal
Params32.8B
Context128K
Smallest20.0 GB
DI
diaryai gguf models
Diaryai · kabirlabs
Params1B
Context32K
Q4_K_M0.5 GB
LE
Lens
Lens · szwagros
Params20.9B
Context128K
Smallest11.9 GB
GE
submission 002 gemma4 12b
Gemma · keenansamway
Params11.9B
Context256K
Smallest7.4 GB
GE
submission 003 gemma4 12b retry
Gemma · keenansamway
Params11.9B
Context256K
Smallest7.4 GB
QW
qwen 2.5 7b trained
Qwen · modmood
Params7.62B
Context128K
Smallest5.1 GB
MI
slim rpcache mistral small 3.2 24b udq4xl
Mistral · Zambizi
Params23.6B
Context128K
Smallest14.5 GB
MI
MiniMax M2.5 PRISM PRO
Minimax · Ex0bit
Params229B
Context192K
Smallest60.3 GB
QW
obliteratus dual model chatbot
Qwen · mido09
Params8.95B
Context256K
Q4_K_M5.7 GB
GE
gemma 4 E4B it resilient qat q4
Gemma · bilal-akhtar-ut
Params7.46B
Context128K
Smallest4.2 GB
MO
model bank
Model · todie
Params23.6B
Context384K
Smallest6.1 GB