IQ2_XS GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 26336 models have a IQ2_XS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
FR
Frank 26B A4B
Frank · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
WI
WizardMath 70B V1.0
Wizardmath · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
PA
MS3.2 PaintedFantasy v4.1 24B Ultra Uncensored Heretic v1
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
ER
ERNIE 4.5 21B A3B Thinking
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
AU
Austral Xgen 9B Winton
Austral · mradermacher
Params10.7B
Context256K
Q4_K_M6.5 GB
OP
openbuddy-zen-3b-v21.2-32k
Openbuddy · mradermacher
Params4.77B
Context32K
Q4_K_M3.0 GB
LL
Llama 3.1 8b Uncensored Dare i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
AL
ALIA 40b Fc 2605
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
GR
Grok Oss Revenant 8B
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GE
Gemma 4 26B Roleplay v2 Merged
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
JA
japanese-stablelm-2-instruct-1_6b
Japanese · mmnga
Params1.64B
Context4K
Q4_K_M1.0 GB
PO
Polar 14B
Polar · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CA
Carnice V2 27b
Carnice · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
PH
Phenom 12B 0.1 i1
Phenom · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GP
GPT OSS Swallow 20B SFT v0.1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GL
GLM 4.7 Flash REAP 23B A3B i1
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
NE
Nekomata 7b Instruction
Nekomata · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
QW
dolphin-2.9.3-qwen2-1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
WI
Wicked Tutu 31B v0.25
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
MY
Mythos 9b Unhinged Heretic
Mythos · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GR
GRiP i1
Grip · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
QW
Openbuddy Qwen2.5Llamaify 14b v23.3 200k
Qwen · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GE
Gemma 4 The Deckards Brain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
AL
AlphaMonarch laser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB