IQ3_XXS GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28129 models have a IQ3_XXS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.
CO
Yi Coder 9B Chat
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
GR
Granite-4.1-3B
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
SH
Shadow Siren 14B Pruned
Shadow · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Huihui Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
OR
Ornith 1.5 35B A3B Heretic MTP APEX GSQ RCO
Ornith · lavendercomputing
Params447M
Context256K
Smallest13.4 GB
LL
OrionStar-Yi-34B-Chat-Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
CY
Cydonia 24B v4.2.0
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 Flash Next FLE
Qwen · sirfyyn
Params177B
Context256K
Smallest1.5 GB
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
DA
Darwin 36B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
OL
Olmo 3.1 32B Instruct
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
DE
Deepseek-Prover-V2-7B
DeepSeek · unsloth
Params6.91B
Context32K
Q4_K_M4.2 GB
NA
VisionPsy Nano 460M GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
GE
Gemma 4 MoonGem 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
PR
PreciseCoder 9B
Precisecoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CY
Cyberdonia 24B v8
Cyberdonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.6 27B Architect Polaris2 Fable B F451 heretic
Qwen · mcgonzo
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · NilVoid
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · DuoNeural
Params8.47B
Context125K
Q4_K_M5.2 GB
VE
Veloxy Flash 15B
Veloxy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
YI
Yi-1.5-6B-Chat
Yi · bartowski
Params6.06B
Context4K
Q4_K_M3.7 GB
G9
G9v3 3B
bartowski
Params3B
Context128K
Q4_K_M1.9 GB
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SM
Smollm3-3B-128K
SmolLM · unsloth
Params3.08B
Context128K
Q4_K_M1.9 GB
VI
Vinci MLE 123B 1.0
Vinci · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB