Q3_K_XL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PO
Polaris 4B Preview
Polaris · bartowski
Params4.02B
Context128K
Q4_K_M2.5 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
OL
AMD OLMo 1B SFT DPO
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
CO
context 1
Context · nicolasembleton
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
QW
OpenR1-Qwen-7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
CA
Captain Eris Violet V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
ME
Megrez 3B Instruct
Megrez · bartowski
Params2.92B
Context32K
Q4_K_M1.8 GB
GGUF
GE
Gemma-3-4B-It
Gemma · Abc7347
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BE
Behemoth 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LL
Llama-3.2-3B-Instruct
Llama · mny1238
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Ministrations 8B v1
Ministrations · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
GL
GLM 5.3 ewaste edition
GLM · SixVolts
Params753B
Context1024K
Smallest7.2 GB
ReasoningTool use
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
SH
L3.3 Unnamed Exp 70B v0.8
Shakudo · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GR
Granite 4.1 3b
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.2 GB
Tool use
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
GE
Gemma-3N-E4B-It
Gemma · Sci-fi-vy
Params6.87B
Context32K
Q4_K_M4.5 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · AskMeCodes
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
IN
Intern S1
InternLM · bartowski
Params235B
Context40K
Q4_K_M142.7 GB
Vision
RE
Replete LLM Mist Nemo 12b
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
UM
L3 Umbral Mind RP v3.0 8B
Umbral · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
NE
OpenMath Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Anubis 70B v1
Negative · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3.1-8B-Think
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
SE
SERA 8B GA
Sera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
huihui ai Qwen3 Coder Next ablisdterated
Qwen · Slaxxis
Params79.7B
Context256K
Q4_K_M48.6 GB
CodingTool use
CY
cybertron v4 qw7B MGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use

Other quants

Keep browsing