Q3_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Replete LLM gemma 9b test merged 250k
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
OR
Tiel Coder 35B A3B GGUF MTP
Ornith · dotnfc
Params447M
Context256K
Smallest13.2 GB
VI
Vibethinker 1.5b Gguf_F16
Vibethinker · constructai
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Qwen3.6-35B-A3B
Qwen · Distillio
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen3.6-35B-A3B-QD
Qwen · QuaduxIT
Params35.5B
Context256K
Smallest10.6 GB
QW
Qwen3.6-27B
Qwen · tybuddy
Params27.3B
Context256K
Q4_K_M17.1 GB
QW
Qwen3.5-9B
Qwen · Mer0vin8ian
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3.5-9B
Qwen · AaryanK
Params8.95B
Context256K
Q4_K_M5.7 GB
GE
Gemma-4-26B-A4B-It-Japanese
Gemma · JMingo
Params19.3B
Context256K
Q4_K_M13.1 GB
BL
.\BlackSheep
Blacksheep · bartowski
Params3.82B
Context8K
Q4_K_M2.3 GB
LL
Llama 3.3 70B Instruct ablated
Llama · Justbackup
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · MuVeraAI
Params31.6B
Context1024K
Q4_K_M23.9 GB
QW
Qwen3.6-27B
Qwen · kimzonick
Params27.3B
Context256K
Q4_K_M17.1 GB
AP
rootxhacker Apollo v3 32B
Apollo · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
KI
Kimi-K2.7-Code
Kimi · eadx
Params1030B
Context256K
Smallest303.9 GB
QW
Qwen3.6-35B-A3B
Qwen · poppingstar
Params35.5B
Context256K
Q4_K_M22.7 GB
LL
Hercules 6.1 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma-4-E4B-It
Gemma · ktruestory
Params7.52B
Context128K
Q4_K_M5.0 GB
QW
Qwen3.8-27B
Qwen · adaliboy
Params27.3B
Context256K
Q4_K_M17.1 GB
QW
Qwen3.5-9B
Qwen · DevinMox
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3.5-0.8B
Qwen · ChuanShun
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.5-0.8B
Qwen · oki602960
Params773M
Context256K
Q4_K_M0.5 GB
GE
Gemma-4-E2B-It
Gemma · fridaycandour
Params4.65B
Context128K
Q4_K_M3.1 GB
HE
Hermes 4 14B
Hermes · genevaquant
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
QW
Qwen3-4B-Instruct-2507
Qwen · Khawarr
Params4.02B
Context256K
Q4_K_M2.5 GB
GE
Gemma-4-31B-It
Gemma · fractaldactal
Params30.7B
Context256K
Q4_K_M18.3 GB
CE
L3-8B-Celeste-v1
Celeste · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5-27B
Qwen · duolaf
Params26.9B
Context256K
Q4_K_M16.7 GB