Q2_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Vl-32B-Thinking
Qwen · unsloth
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
QW
Qwen3.8-27B
Qwen · emee-ai
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen_Qwen3 4B
Qwen · Alcoft
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
FA
Falcon-H1-7B-Instruct
Falcon · unsloth
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
GE
gemma-4-12B-it-heretic
Gemma · JMingo
Params11.9B
Context256K
Q4_K_M7.1 GB
Coding
LL
Cogito-V2-Preview-Llama-109B-Moe
Llama · unsloth
Params108B
Context256K
Q4_K_M65.4 GB
Vision
GE
Gemma-3-4B-It
Gemma · zw89
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GR
Granite-4.0-1B
Granite · unsloth
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · OS-Software
Params25.2B
Context256K
Smallest9.9 GB
Reasoning
IN
Januscoder-8B
InternLM · unsloth
Params8.19B
Context32K
Q4_K_M5.0 GB
CodingVision
AP
Apriel-1.5-15B-Thinker
Apriel · unsloth
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
QW
Qwq-32B
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.5-4B
Qwen · Mazaxaka777
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
LI
Ling-1T
Ling · unsloth
Params1000B
Context32K
Q4_K_M604.7 GB
GGUF
QW
shisa v2.1 qwen3 8b UD japanese imatrix
Qwen · dahara1
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3-1.7B
Qwen · XythicK
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
LF
Lfm2-700M
Lfm · unsloth
Params742M
Context32K
Q4_K_M0.5 GB
GGUF
QW
Qwen3.5-4B
Qwen · cmp-nct
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.5-4B
Qwen · ISTA-DASLab
Params4.21B
Context256K
Smallest1.9 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · python-jo
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · Fix-AI
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
GE
gemma 4 E4B it UD japanese imatrix
Gemma · dahara1
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
QW
Qwen3.5-4B
Qwen · Heppygaga
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · natalie5
Params1.63B
Context1024K
Smallest1.3 GB
Vision
FA
Falcon-H1-1.5B-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
QW
Qwen3.5-4B
Qwen · Limeboi
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3-Coder-480B-A35B-Instruct-1M
Qwen · unsloth
Params480B
Context1024K
Q4_K_M290.1 GB
Coding
QW
Qwen3-Vl-235B-A22B-Thinking-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
ReasoningVision
QW
Qwen3-Vl-32B-Thinking-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
ReasoningVision
QW
Qwen3.5-4B
Qwen · mistaplanet
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision

Other quants

Keep browsing