GGUF models by Abiray
108 GGUF models quantized by Abiray on Hugging Face. Sizes run from 134M to 197B parameters. The longest trained context is 1024K tokens.
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Huihui Qwen3.6 27B abliterated Q4 K M
Qwen · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 E4B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · Abiray
Params7.5B
Context128K
Q4_K_M5.3 GB
ER
10Eros Max ref2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
ZA
ZAYA1 8B
Zaya · Abiray
Params8.84B
Context128K
Q4_K_M5.6 GB
GE
gemma 4 E4B it OBLITERATED
Gemma · Abiray
Params7.46B
Context128K
Q4_K_M5.3 GB
MI
Huihui Ministral 3B Instruct 2512 abliterated
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
MiniCPM5 2B
MiniCPM · Abiray
Params2.52B
Context128K
Q4_K_M1.6 GB
MI
MiniCPM5 1B
MiniCPM · Abiray
Params1.08B
Context128K
Q4_K_M0.7 GB
AN
Anima aesthetic v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
MU
Muse Glimmer 30B
Muse · Abiray
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest24.7 GB
FA
Fara1.5 27B
Fara · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 9B Abliterated Claude 4.6 Opus Reasoning Distilled
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.6 35B A3B heretic Q4 K M
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
LA
Lance 3B Video
Lance · Abiray
Params6.44B
Context—
Q4_K_M5.0 GB
SU
supergemma4 e4b abliterated
Supergemma · Abiray
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest16.8 GB
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest19.9 GB
GE
Gemma 4 31B It Claude Opus Distill
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
NA
Nanbeige4.2 3B
Nanbeige · Abiray
Params4.17B
Context256K
Q4_K_M2.6 GB
QW
Qwen3.5 2B heretic
Qwen · Abiray
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.6 27B Heretic ARA
Qwen · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest36.9 GB
GE
Gemma 4 E4B Gemini 3.1 Pro Reasoning Distill v2 Merged
Gemma · Abiray
Params7.52B
Context128K
Q4_K_M5.3 GB
ID
ideogram 4
Ideogram · Abiray
Params9.28B
Context—
Smallest5.6 GB
QI
Qianfan OCR
Qianfan · Abiray
Params4.42B
Context32K
Q4_K_M2.7 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · Abiray
Params37.4B
Context512K
Q4_K_M22.4 GB
HU
Huihui Qwopus3.5 4B v3 abliterated
Huihui · Abiray
Params4.21B
Context256K
Q4_K_M2.7 GB