Q2_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 962 models have a Q2_K_XL file. Sizes run from 92M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
crislang models
Gemma · yerzer
Params4.63B
Context128K
Smallest2.2 GB
ReasoningTool use
GE
Gemma-4-E2B-It
Gemma · 0x3
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
KI
Kimi-K3
Kimi · mmnga-o
Params737B
Context1024K
Smallest194.0 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · 2531oupp
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
vai 8b
Qwen · votal-ai
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3.5-4B
Qwen · harsha-math
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
DE
DeepSeek V4 Flash 0731
DeepSeek · speakguru
Params284B
Context1024K
Smallest10.9 GB
GGUF
EV
meituan EvoCUA 32B 20260105
Evocua · spicyneuron
Params32.8B
Context256K
Smallest12.8 GB
ReasoningTool useVision
GE
Gemma-4-E2B-It
Gemma · heyAadi
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
GE
Gemma-4-E2B-It
Gemma · redmik60
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
QW
Qwen3.5 122B A10B DASHQ Q2
Qwen · jkim96
Params122B
Context256K
Smallest35.9 GB
GGUF
QW
Qwen3.5-0.8B
Qwen · sinatras
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen2.5 VL 3B Instruct DASHQ Q2
Qwen · jkim96
Params3.09B
Context125K
Smallest0.9 GB
Vision
GE
Gemma-4-E4B-It
Gemma · manojbillionaire123
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision
GE
Gemma-4-E2B-It
Gemma · gijl
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
DE
DeepSeek V4 Flash 0731
DeepSeek · Stk88
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · lyssquant
Params284B
Context1024K
Smallest10.9 GB
GGUF
GE
gemma 4 E4B it qat
Gemma · alekshandru
Params7.46B
Context128K
Smallest0.1 GB
ReasoningTool useVision
QW
intel mac local llm
Qwen · miutti
Params22.6B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen3.5-0.8B
Qwen · votal-ai
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3.5-0.8B
Qwen · BiAffect
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
Gemma-4-31B-It
Gemma · glymm
Params30.7B
Context256K
Q4_K_M18.3 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · Viral2AI
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · jkim96
Params8.03B
Context128K
Smallest2.5 GB
Tool use
GE
Gemma-4-26B-A4B-It-Japanese
Gemma · JMingo
Params13.2B
Context256K
Q4_K_M9.1 GB
ReasoningTool use
GE
Gemma-4-E2B-It
Gemma · dudeidkwhattodo
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
GE
Gemma-4-E2B-It
Gemma · manojbillionaire123
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
QW
Qwen4
Qwen · stealth-model
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision
GE
LaToucheCarre Texte M Gemma 4 E2B Q2 K XL FR EN
Gemma · LaToucheCarre
Params3.56B
Context128K
Smallest1.8 GB
ReasoningTool use
GE
Gemma-4-E4B-It
Gemma · gijl
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision

Other quants

Keep browsing