Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt-Oss-20B
gpt-oss · mangaba-ai
Params20.9B
Context128K
Smallest11.9 GB
Tool use
GE
gemma 4 12B it qat
Gemma · Amod1arc
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
QW
Qwen3.5-0.8B
Qwen · manojbillionaire123
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GP
Gpt-Oss-120B
gpt-oss · 1bit-MONSTER
Params117B
Context128K
Smallest63.0 GB
Tool use
KI
Kimi-K2.6
Kimi · Shadiamr
Params1030B
Context256K
Smallest340.5 GB
ReasoningTool useVision
GE
Gemma-4-26B-A4B-It-Japanese-64e
Gemma · JMingo
Params13.2B
Context256K
Smallest7.4 GB
ReasoningTool use
GL
GLM 4.7 PRISM Unsloth
GLM · the-fall-of-man
Params353B
Context198K
Smallest82.7 GB
ReasoningTool use
GP
Gpt-Oss-20B
gpt-oss · drwhall
Params20.9B
Context128K
Q4_K_M11.6 GB
Tool use
LF
Lfm2.5-230M
Lfm · Felladrin
Params230M
Context125K
Smallest0.2 GB
ReasoningTool use
QW
Qwen3.5-2B
Qwen · XpressAI
Params2.11B
Context256K
Smallest1.5 GB
ReasoningTool use
QW
Swift Qwen3.8 27B Dynamic
Qwen · moontato
Params27.3B
Context256K
Smallest17.6 GB
ReasoningTool use
RE
ai researcher
Researcher · dimka007
Params4.65B
Context256K
Smallest1.3 GB
ReasoningTool use
NP
npc models
Npc · shuko-tuto
Params11.9B
Context32K
Q4_K_M1.0 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · XpressAI
Params28.8B
Context256K
Smallest18.9 GB
ReasoningTool use
QW
Qwen3.6-27B
Qwen · oolfBER
Params27.3B
Context256K
Smallest17.9 GB
ReasoningTool use
QW
Mangaba Qwen3 Coder 30B A3B
Qwen · mangaba-ai
Params30.5B
Context256K
Smallest17.7 GB
CodingTool use
QW
Qwen3.5-27B
Qwen · Manojb
Params26.9B
Context256K
Smallest17.6 GB
ReasoningTool useVision
QW
Qwen3.6-27B
Qwen · Evilcarbon
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
catareeya 4 12b qat
Gemma · tokenine
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
QW
Qwen3.6-27B
Qwen · dskvngsfdjlksn
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · DOMINICDA
Params9.2B
Context256K
Q4_K_M5.9 GB
ReasoningTool useVision
LF
Neve Cascade 4 1.2B
Lfm · NeveAI
Params1.17B
Context125K
Smallest0.7 GB
Tool use
AN
Antanom
Antanom · Faris-Faiz
Params26.9B
Context256K
Smallest17.2 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · mangaba-ai
Params34.7B
Context256K
Smallest22.4 GB
ReasoningTool use
JO
jobmatch models
Jobmatch · Aletogno
Params7.46B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3.5 Unsloth GGUF R9700 Benchmark
Qwen · JohnTdi
Params26.9B
Context256K
Q4_K_M16.7 GB
ReasoningTool use
LL
H LLM LOCAL
Llm · sdasdawq234
Params7.5B
Context128K
Smallest3.7 GB
Vision
GE
gemma 3 4b it unslop GRPO v2
Gemma · electroglyph
Params3.88B
Context128K
Smallest2.5 GB
Vision
AI
f5aiteam clip
Aiteam · fwwrsd
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
TE
textonly
Textonly · cccucumber
Params29.9B
Context198K
Smallest13.8 GB
ReasoningTool use

Other quants

Keep browsing