Q4_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
JA
Jan code 4b
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
LA
Laguna-S-2.1
Laguna · unsloth
Params118B
Context256K
Q4_K_M73.1 GB
QW
Suri Qwen 3.8 27B Companion
Qwen · SpaceTimee
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Signal 3.8 27B
Qwen · agentionai
Params27.3B
Context—
Q4_K_M17.0 GB
SM
Smollm3-3B
SmolLM · unsloth
Params3.08B
Context64K
Q4_K_M1.9 GB
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M23.9 GB
MI
Ministral-3-8B-Reasoning-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
MiniMax M3.1 Flash
Minimax · unsloth
Params426B
Context1024K
Smallest0.5 GB
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
QW
Qwen3-4B-Thinking-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Q4_K_M0.5 GB
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
NA
Nanonets-Ocr-S
Nanonets · unsloth
Params3.1B
Context125K
Q4_K_M1.9 GB
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Smallest6.7 GB
MO
MOSS Image Base
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
MI
Ministral-3-3B-Reasoning-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
HY
Hy-Mt2-7B
unsloth
Params7.5B
Context256K
Q4_K_M4.6 GB
QW
Qwen3-Coder-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context1024K
Q4_K_M18.6 GB
OR
Ornith 1.0 35B
Ornith · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
ST
Step-3.7-Flash
Step · unsloth
Params197B
Context256K
Q4_K_M122.1 GB
QW
Qwen3-235B-A22B
Qwen · unsloth
Params235B
Context40K
Q4_K_M142.2 GB
MI
Mistral-Medium-3.5-128B
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
QW
Qwen3 Coder 30B A3B
Qwen · AtomicChat
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
Sharp MiniCPM5 2B
MiniCPM · peculiar-ragdoll
Params2.52B
Context—
Smallest0.0 GB