Q4_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · Alcoft
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
LL
Llama-3.2-1B-Instruct
Llama · RekcyDecky
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Qwen3.8-27B
Qwen · oolfBER
Params27B
Context256K
Smallest17.9 GB
GGUF
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · cartoon45
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
GE
gemma-4-E2B-it-ultra-uncensored-heretic
Gemma · JMingo
Params4.63B
Context128K
Q4_K_M3.1 GB
ReasoningTool use
EL
EleMo V2 Base
Elemo · Earlychildhoodeducation
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
MI
Pixtral Large Instruct 2411
Mistral · EnlistedGhost
Params123B
Context128K
Smallest46.7 GB
Vision
QW
Qwen3.8-27B
Qwen · FenomAI
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
MI
Ministral 3 14B Reasoning 2512
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M9.2 GB
ReasoningVision
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · Kazuya-Nomura-zer0
Params177B
Context256K
Q4_K_M2.6 GB
ReasoningTool use
QW
FlashModel Qwen3.5 9B
Qwen · flashback2k
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GL
GLM 5.2 ewaste edition
GLM · SixVolts
Params754B
Context1024K
Smallest243.6 GB
ReasoningTool use
QW
Atomic Chat / Qwen2.5 14B Instruct
Qwen · AtomicChat
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MI
Mimo-Vl-7B-Rl
Mimo · akpsahan
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3 8B
Qwen · EnlistedGhost
Params8.19B
Context40K
Q4_K_M5.3 GB
ReasoningTool use
GE
gemma4 31b it
Gemma · AlexAtomic
Params31B
Context256K
Q4_K_M18.7 GB
Vision
NE
Nemotron 3.5 Bolt E4B Artemis
Nemotron · turintech
Params7.52B
Context64K
Smallest3.7 GB
ReasoningTool use
QW
Qwen3.5-9B
Qwen · duolaf
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
GE
Gemma-3-27B-It
Gemma · tripolskypetr
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen3.6 27B Claude Opus Reasoning UD Q4 K RA XL
Qwen · DAXZEIT
Params26.9B
Context256K
Smallest18.4 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · bramburn
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · EnlistedGhost
Params8.19B
Context128K
Q4_K_M5.2 GB
Reasoning
QW
Qwen3-8B
Qwen · cmp-nct
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · vs4vijay
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
QW
Qwen3 4B Instruct 2507 uncensored unslop v2
Qwen · electroglyph
Params4.02B
Context256K
Smallest2.5 GB
ReasoningTool use
KI
Kimi-K2-Instruct
Kimi · jobs-git
Params1030B
Context128K
Q4_K_M620.8 GB
CodingTool use
QW
Qwen3.6-35B-A3B
Qwen · opensota
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
FE
Fenrir X 26B A4B UD Q4 K XL
Fenrir · KaviarLabs
Params25.2B
Context256K
Smallest0.1 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · Dinosaur-tothe-sky
Params34.7B
Context256K
Q4_K_M22.0 GB
ReasoningTool useVision
GE
Gemma 4 E4B It Heretic
Gemma · SassyDiffusion
Params7.46B
Context128K
Q4_K_M5.2 GB
ReasoningTool useVision

Other quants

Keep browsing