Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Ling 3.0 Flash Fin
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
Tool use
QW
Qwen3.8-27B
Qwen · rax4901
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
HE
Hermes 4.3 36B
Hermes · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
GE
Gemma 4 Dark Thoughts 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
RoleplayVision
QW
Qwen3.8-27B
Qwen · loscrossos
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
Coding
OR
Ornith-1.5-35B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
GGUF
MU
Muse Glimmer 30B Heretic
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
MU
Muse Glimmer 30B Esper4
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
CodingReasoningVision
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Q4_K_M8.6 GB
Reasoning
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Q4_K_M2.5 GB
Vision
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
GGUF
GE
Gemma 4 31B It Scotoma 2
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
KI
Kimi-K2-Thinking
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
Reasoning
LO
LongWriter Zero 32B
Longwriter · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
LL
Llama-3_3-Nemotron-Super-49B-V1_5
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
MI
Minimax-M2.5
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Vision
QW
Qwen3.8-27B
Qwen · LxBarn
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
EU
EuroLLM 9B Instruct
Eurollm · bartowski
Params9.15B
Context4K
Q4_K_M5.6 GB
GGUF
MI
mathstral-7B-v0.1
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
AN
Anubis Mini 8B v1
Anubis · bartowski
Params8B
Context128K
Q4_K_M5.1 GB
GGUF
QW
QwQ 32B Abliterated
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
GE
Gemma-3-270M-It-Qat
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF

Other quants

Keep browsing