Q3_K_XL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2589 models have a Q3_K_XL file. Sizes run from 30M to 1050B parameters. The longest trained context is 10240K tokens.
QW
trashpanda org QwQ 32B Snowdrop v0
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
LL
Llama-3_3-Nemotron-Super-49B-V1
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
FA
Fara 7B
Fara · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
TA
UI TARS 2B SFT
Tars · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
CO
C4Ai Command A 03 2025
Command R · bartowski
Params111B
Context16K
Q4_K_M67.1 GB
GE
Gemma-4-E4B-It
Gemma · Hlebek
Params7.52B
Context128K
Q4_K_M5.0 GB
QW
Replete LLM V2.5 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
CO
ContextPilot 14B
Contextpilot · bartowski
Params14.8B
Context40K
Q4_K_M9.3 GB
CY
Cydonia 24B v3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
VE
Q25 1.5B VeoLu
Veolu · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
QW
Qwen2.5 Gutenberg Doppel 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GR
Grug 35b
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
Qwen3.8 27B Uncensored
Qwen · Guile
Params27.3B
Context256K
Q4_K_M17.8 GB
MA
magnum v2 4b
Magnum · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
DI
Dictalm-3.0-24B-Thinking
Dictalm · unsloth
Params23.6B
Context64K
Q4_K_M14.3 GB
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
HY
Hypnos I1 8B
Hypnos · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Virtuoso Medium
Qwen · arcee-ai
Params32.8B
Context128K
Q4_K_M19.8 GB
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
MI
MiMo VL 7B RL 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
ST
Stheno Hercules 3.1 8B
Stheno · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
GR
Granite 3.3 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB