GGUF models by Abiray
108 GGUF models quantized by Abiray on Hugging Face. Sizes run from 134M to 197B parameters. The longest trained context is 1024K tokens.
QW
Qwen3.6 27B AEON Ultimate Uncensored
Qwen · Abiray
Params27B
Context256K
Q4_K_M16.5 GB
OV
OvisOCR2
Ovisocr · Abiray
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.8 Flash Next Orca Abliterated GSQ RCO Coder
Qwen · Abiray
Params117B
Context256K
Smallest58.7 GB
QW
Qwen Image 2.1 viggle turbo v0.3 6step
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
AR
Artemis 31B v1.2
Artemis · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
SE
SenseNova 6.8 Code2Video MTP
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
QW
ComfyUI Qwen3 VL
Qwen · Abiray
Params8.77B
Context256K
Q4_K_M2.5 GB
AN
Anima base v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
KR
Kroma v0.3.1 Turbo OPD
Kroma · Abiray
Params12.8B
Context—
Q4_K_M8.8 GB
FL
flint 40B A2.5B Q4 K M
Flint · Abiray
Params39.8B
Context256K
Q4_K_M24.1 GB
LT
LTX2.3 10Eros 1.4 Split
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
FI
Fibo 2.0 edit turbo
Fibo · Abiray
Params8.23B
Context—
Q4_K_M5.3 GB
HA
harrier oss v1 27b
Harrier · Abiray
Params27B
Context128K
Q4_K_M16.6 GB
GE
Gemma 4 12B it AEON Abliterated K4
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
MI
Minimax h3 Singularity V2 Pruned
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
QW
Qwen3.5 4B Python Coder
Qwen · Abiray
Params4.2B
Context256K
Q4_K_M2.7 GB
SU
Sulphur 2 base
Sulphur · Abiray
Params21B
Context—
Q4_K_M14.3 GB
QW
Qwen3.5 9B Abliterated Claude 4.6 Opus Reasoning Distilled v2
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
LT
LTX2.3 10Eros
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
MI
Mistralai Shieldstral 1.0 3B
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
HU
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated
Huihui · Abiray
Params9.2B
Context1024K
Q4_K_M5.8 GB
GE
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
LT
LTX2.3 10Eros 1.3
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
ER
10Eros Max
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
QW
Qwen3.6 35B A3B heretic
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
VI
Viggle Animate pruned
Viggle · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
ER
10Eros Max fl2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
AN
Anima turbo v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
MI
MiniMax Music3
Minimax · Abiray
Params2.46B
Context—
Q4_K_M1.5 GB
OU
thesysdev_OUI 1
Oui · Abiray
Params25.3B
Context256K
Q4_K_M16.8 GB