Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 12B it qat uncensored heretic UDmerge
Gemma · EZForever
Params11.9B
Context256K
Smallest6.7 GB
ReasoningTool useVision
GE
Gemma-3N-E4B-It
Gemma · Sci-fi-vy
Params6.87B
Context32K
Q4_K_M4.5 GB
Vision
PU
public models
Public · motgame
Params4.63B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · AskMeCodes
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
LL
shisa v2.1 llama3.2 3b UD japanese imatrix
Llama · dahara1
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen3.8 Flash Next
Qwen · AMAImedia
Params177B
Context256K
Smallest111.3 GB
ReasoningTool useVision
GE
gemma 4 31B it qat uncensored heretic UDmerge
Gemma · npario
Params30.7B
Context256K
Smallest17.3 GB
ReasoningTool useVision
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
GGUF
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · Shaeh
Params177B
Context256K
Q4_K_M2.6 GB
ReasoningTool useVision
EM
Embeddinggemma 2
Embeddinggemma · Fastiraz
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision
QW
Qwen3.5-9B
Qwen · karlsencoin
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
OR
cn3nctie2nc92bbc9nxxj93
Ornith · AIGAROU
Params447M
Context256K
Smallest12.7 GB
Vision
QW
Qwen3.8-27B
Qwen · xShubx
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · XythicK
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · lovedheart
Params48.9B
Context256K
Smallest22.9 GB
CodingTool use
GE
Gemma-3-4B-It
Gemma · tripolskypetr
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
ReasoningTool use
MI
Ministral 3 8B Reasoning 2512
Mistral · EnlistedGhost
Params8.49B
Context256K
Q4_K_M5.5 GB
ReasoningVision
QW
Qwen3.8 27B ComfyUI
Qwen · Rom3rk
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · Shananhux
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
GE
Gemma-3-1B-It
Gemma · tripolskypetr
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
IN
Internvl3-38B
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool useVision
QW
Qwen3.8-27B
Qwen · Sh200126
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
SU
SU 01
axi0mX
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
QW
Qwen3.5-0.8B
Qwen · matthewj-t6
Params752M
Context256K
Q4_K_M0.5 GB
Vision
MI
Magistral Small 2509 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M12.6 GB
ReasoningTool useVision
GE
Gemma-3-4B-It
Gemma · sahadat369
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen2.5-Vl-7B-Instruct
Qwen · goushuai123
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.5-9B
Qwen · Xlnk
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
QW
Qwen3.6-27B
Qwen · cmp-nct
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision

Other quants

Keep browsing