Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
ER
Ernie-4.5-21B-A3B-Pt
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
MI
Devstral-2-123B-Instruct-2512
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
SE
Seed-Oss-36B-Instruct
Seed · unsloth
Params36.2B
Context512K
Q4_K_M21.8 GB
ME
Medgemma-27B-Text-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
JA
Jan-Nano-128K
Jan · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
GR
Granite-4.0-H-Micro
Granite · unsloth
Params3.2B
Context1024K
Q4_K_M1.9 GB
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
ME
Medgemma-27B-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
OL
Olmo-3-7B-Instruct
OLMo · unsloth
Params7.3B
Context64K
Q4_K_M4.5 GB
GE
Gemma-3-27B-It-Qat
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3-235B-A22B-Thinking-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
GR
Granite-4.0-H-Tiny
Granite · unsloth
Params6.94B
Context1024K
Q4_K_M4.3 GB
GL
GLM 5.3 Flash Uncensored
GLM · axi0mX
Params321B
Context1024K
Smallest93.3 GB
QW
Qwen3.8 27B Whitehat
Qwen · QuaduxIT
Params27.3B
Context256K
Q4_K_M16.8 GB
OR
RegesCore 1.0 35
Ornith · iBossonline
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen2.5-Omni-3B
Qwen · unsloth
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3.6 35B A3B MTP
Qwen · havenoammo
Params845M
Context256K
Smallest0.9 GB
GR
Granite-4.1-3B
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
DE
Deepseek-Prover-V2-7B
DeepSeek · unsloth
Params6.91B
Context32K
Q4_K_M4.2 GB
QW
Qwen3.8-27B
Qwen · NilVoid
Params27.3B
Context256K
Q4_K_M16.6 GB
SM
Smollm3-3B-128K
SmolLM · unsloth
Params3.08B
Context128K
Q4_K_M1.9 GB
QW
Qwen3.8-27B
Qwen · ahmed-amedo
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3-Vl-30B-A3B-Thinking
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB