Q4_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1216 models have a Q4_K_XL file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
Llama-3_1-Nemotron-Ultra-253B-V1
Llama · unsloth
Params253B
Context128K
Q4_K_M150.9 GB
GL
GLM 5.3 Flash
GLM · therickcain
Params321B
Context1024K
Smallest93.1 GB
MI
Luau Devstral 24B Instruct v0.2
Mistral · TorpedoSoftware
Params23.6B
Context128K
Smallest0.0 GB
PH
Phi 4 mini instruct
Phi · AtomicChat
Params3.84B
Context128K
Q4_K_M2.5 GB
HE
Hermes-4-405B
Hermes · unsloth
Params405B
Context128K
Q4_K_M243.1 GB
QW
Qwen3.8-27B
Qwen · testingusera1
Params27.3B
Context256K
Q4_K_M16.5 GB
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
Magistral-Small-2507
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
GE
Gemma-3-270M-It
Gemma · Sci-fi-vy
Params268M
Context32K
Q4_K_M0.3 GB
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
EL
EleMo V3 Base
Elemo · Earlychildhoodeducation
Params27.3B
Context256K
Q4_K_M16.5 GB
IN
Internvl3-8B-Instruct
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
Qwen3-0.6B
Qwen · openwalrus
Params596M
Context40K
Q4_K_M0.4 GB
QW
Luau Qwen3 4B FIM v0.1
Qwen · TorpedoSoftware
Params4.02B
Context256K
Smallest2.1 GB
GL
GLM 5.3 Flash
GLM · Ashwinxs
Params321B
Context1024K
Smallest93.1 GB
IN
Internvl3-14B
Internvl · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
GL
GLM 5.3 Flash
GLM · AshwinX
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3-1.7B
Qwen · openwalrus
Params1.72B
Context40K
Q4_K_M1.1 GB
TI
Tigerlily R3
Tigerlily · EnlistedGhost
Params11.8B
Context128K
Q4_K_M6.9 GB
GP
Gpt-Oss-Safeguard-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
QW
Qwen3.8-27B
Qwen · SwinliQ-AIn-2
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Huihui Qwen3.6 27b
Qwen · YuYu1015
Params27.3B
Context256K
Smallest17.8 GB
QW
Qwen3.5-27B
Qwen · cmp-nct
Params26.9B
Context256K
Q4_K_M16.7 GB
QW
Qwen3-4B
Qwen · openwalrus
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Dirk Qwen3.8 27B
Qwen · blackfan23
Params27.3B
Context256K
Smallest8.8 GB
GE
Gemma-4-31B-It
Gemma · Darkknight535
Params30.7B
Context256K
Q4_K_M18.3 GB
GE
Gemma-3-12B-It
Gemma · tripolskypetr
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.8 Flash Next
Qwen · bitlamas
Params177B
Context256K
Smallest102.5 GB
IN
Intellect-2
Intellect · unsloth
Params32.8B
Context40K
Q4_K_M19.9 GB