Q2_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.
LF
Lfm2-1.2B
Lfm · unsloth
Params1.17B
Context32K
Q4_K_M0.7 GB
ER
Ernie-4.5-0.3B-Pt
Ernie · unsloth
Params361M
Context128K
Q4_K_M0.2 GB
QW
Qwen3-Vl-235B-A22B-Thinking
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
QW
Qwen_Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
IN
Internvl3-8B
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
DE
Deepseek-Prover-V2-671B-Bf16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.5 GB
GR
Granite-4.1-30B
Granite · unsloth
Params28.9B
Context128K
Q4_K_M17.5 GB
MI
Pixtral
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.7 GB
GE
Huihui gemma 4 31B it abliterated v2
Gemma · groxaxo
Params30.7B
Context—
Smallest0.0 GB
QW
Qwen3-Vl-235B-A22B-Instruct-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
QW
Qwen_Qwen3 4B Thinking 2507
Qwen · Alcoft
Params4B
Context256K
Q4_K_M2.4 GB
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
QW
Qwen2.5-Vl-7B-Instruct
Qwen · mnsims1024
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3-Vl-4B-Thinking-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
MI
Minimax H3 pruned
Minimax · PurpleBlazey
Params20.1B
Context256K
Smallest6.3 GB
QW
Qwen3-16B-A3B
Qwen · unsloth
Params16B
Context40K
Q4_K_M9.8 GB
QW
Qwen3.8-27B
Qwen · SeraphicHero
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · Snowwhite00
Params27.3B
Context256K
Q4_K_M16.5 GB
GE
Gemma-4-26B-A4B-It-Ultra-Uncensored-Heretic
Gemma · JMingo
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
UD 2.0 Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mfielding92
Params34.7B
Context256K
Q4_K_M22.1 GB
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
QW
Qwen3.5-4B
Qwen · Fix-AI
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma 4 12B It Qat
Gemma · dahara1
Params11.9B
Context256K
Q4_K_M7.1 GB
QW
Qwen3-32B
Qwen · openwalrus
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3-Vl-4B-Instruct-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · ariel-pillar
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
Olmo-3.1-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Sci-fi-vy
Params23.6B
Context128K
Q4_K_M14.3 GB