Q2_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
Vision
QW
Qwen3-32B-128K
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
QW
dnotitia_Smoothie Qwen3 0.6B
Qwen · Alcoft
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
GR
Granite-4.0-Micro
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · mnsims1024
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Qwen3.8-27B
Qwen · hammadRahman
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
GR
Granite-4.0-H-1B
Granite · unsloth
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
QW
Qwen3-Vl-2B-Instruct-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
Vision
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params403B
Context256K
Q4_K_M248.8 GB
Vision
LF
Lfm2.5-1.2B-Thinking
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
Reasoning
GE
Gemma-4-E2B-It
Gemma · UnitGrief
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
CodingReasoning
JA
Jan-Nano
Jan · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
FA
Falcon-H1-0.5B-Instruct
Falcon · unsloth
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
QW
Qwen3-Vl-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
Vision
OL
Olmo-3.1-32B-Instruct
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
MI
MiniMax H3
Minimax · ldov
Params20.1B
Context—
Q4_K_M18.2 GB
GGUF
NE
Dory1.0 4B BF16 Llamacpp
Nemotron · cloudnathan5
Params3.98B
Context256K
Q4_K_M2.4 GB
GGUF
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
GGUF
QW
Qwen3.8 27B Uncensored Heretic v2
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
Vision
LF
Lfm2.5-Vl-1.6B
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
Vision
LL
Llama-3_3-Nemotron-Super-49B-V1
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
Coding
GE
Gemma-4-E4B-It
Gemma · Hlebek
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
GGUF
DI
Dictalm-3.0-24B-Thinking
Dictalm · unsloth
Params23.6B
Context64K
Q4_K_M14.3 GB
Reasoning
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen3.8-27B
Qwen · Fix-AI
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
PH
Phi-4-Reasoning
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
QW
Qwen_Qwen3 1.7B
Qwen · Alcoft
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
Vision

Other quants

Keep browsing