Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · OS-Software
Params7.46B
Context128K
Smallest3.7 GB
Vision
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
LF
Lfm2.5-230M
Lfm · unsloth
Params230M
Context125K
Q4_K_M0.2 GB
GGUF
GE
Big Tiger Gemma 27B v3
Gemma · bartowski
Params28.4B
Context128K
Q4_K_M17.3 GB
Vision
CO
Command A Plus 05 2026
Command · bartowski
Params218B
Context195K
Q4_K_M135.1 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
GR
Granite 4.2 30b
Granite · bartowski
Params29.3B
Context128K
Q4_K_M18.0 GB
ReasoningTool use
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
KO
Kolibri 1
Kolibri · InsidiousFiddler
Params78B
Context256K
Smallest37.5 GB
Reasoning
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
Roleplay
CY
Cydonia 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
NO
NousCoder 14B
Nouscoder · bartowski
Params14.8B
Context80K
Q4_K_M9.0 GB
Coding
QW
Qwen3.6-35B-A3B
Qwen · cmp-nct
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
EL
Steelskull L3.3 Electra R1 70b
Electra · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Emma 500 Llama2 7b
Llama · bartowski
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SK
Skywork OR1 Math 7B
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
Magistral-Small-2506
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningVision
NE
Nemotron-3.5-Bolt-E4B-Heretic
Nemotron · grumd0
Params7.46B
Context64K
Smallest3.7 GB
ReasoningTool useVision
QW
Qwen3-235B-A22B-128K
Qwen · unsloth
Params235B
Context128K
Q4_K_M142.2 GB
GGUF
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
IN
InternVL3_5 4B
Internvl · bartowski
Params4.41B
Context40K
Q4_K_M2.7 GB
Vision
SN
Snowpiercer 15B v4
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
WO
WorldSim Opus 3.6 35B A3B
Worldsim · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningRoleplayVision
GE
Gemma 3 12b It Qat
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
QVQ 72B Preview
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision

Other quants

Keep browsing