IQ2_XS GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 26336 models have a IQ2_XS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Uncensored
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
QW
Qwen3 Zero Coder Reasoning V2 0.8B NEO EX
Qwen · DavidAU
Params816M
Context40K
Q4_K_M0.5 GB
QW
Qwen 3.5 27B Derestricted
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NA
Nanbeige4.3 33B
Nanbeige · abenzerps
Params33.1B
Context512K
Smallest9.9 GB
OR
Ornith 1.5 9B
Ornith · abenzerps
Params8.95B
Context256K
Smallest2.8 GB
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
NA
Nanbeige4.2 3B
Nanbeige · gkraker04
Params4.17B
Context256K
Q4_K_M2.6 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · NANI-Nithin
Params37.4B
Context512K
Q4_K_M22.4 GB
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
MI
minmax
Minmax · Kutches
Params20.1B
Context—
Q4_K_M11.5 GB
QW
Suri Qwen 3.8 27B Companion
Qwen · SpaceTimee
Params27.3B
Context256K
Q4_K_M16.5 GB
MI
MiniMax-M3.1-Flash
Minimax · LyJonathan
Params426B
Context1024K
Smallest94.8 GB
QW
Qwen3 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
OM
Omega Arsenal 12B
Omega · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
LF
LFM2.5-24B-A2B
Lfm · NANI-Nithin
Params24B
Context128K
Q4_K_M14.5 GB
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
ME
Melody1437 26B A4B v2.0
Melody · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Qwen3.8 27B Uncensored Heretic Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Meta llama_Meta Llama 3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
LY
Lythri 4B A2B
Lythri · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GP
OpenAI Gpt Oss 20B Claude 4.5 Opus Heretic Uncensored
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB