GGUF models by Abiray

108 GGUF models quantized by Abiray on Hugging Face. Sizes run from 134M to 197B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniMax H3 Pruned
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
MI
MiniMax H3
Minimax · Abiray
Params25.8B
Context—
Q4_K_M14.6 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS
DeepSeek · Abiray
Params197B
Context—
Smallest110.6 GB
GGUF
NE
Nemotron 3 Embed 8B BF16
Nemotron · Abiray
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
QW
Qwen Image 2.1 Turbo
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
QW
Qwen Image 2.1 viggle 4 steps turbo
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
LT
LTX 2.5 Distilled
Ltx · Abiray
Params21B
Context—
Q4_K_M15.7 GB
GGUF
QW
Qwen Image 2.1
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
QW
Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
FL
flux 3 image klein sd
Flux · Abiray
Params5.55B
Context—
Q4_K_M3.3 GB
GGUF
MI
MiniMax H3 Singularity
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
QW
Huihui Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
MI
MiniCPM5 2B heretic abliterated
MiniCPM · Abiray
Params2.52B
Context128K
Q4_K_M1.6 GB
GGUF
WA
Wan2.2 LightX2V 260412 4STEP
Wan · Abiray
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Huihui Qwen3.6 35B A3B abliterated
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
RoleplayVision
LT
LTX 2.3 22B DISTILLED 1.1
Ltx · Abiray
Params21B
Context—
Q4_K_M17.8 GB
GGUF
GE
gemma 4 E4B it heretic
Gemma · Abiray
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingVision
MI
MiniCPM V 4.7 1B abliterated heretic
MiniCPM · Abiray
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
QW
Qwen3.8 27B Q4 K M
Qwen · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
FA
FastH3 Omni
Fasth · Abiray
Params22.1B
Context—
Q4_K_M12.7 GB
GGUF
KR
Krea 2 Turbo
Krea · Abiray
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
MI
MiniMax H3 Pruned Ref Delta Fused
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
SC
SCAIL 2
Scail · Abiray
Params16.4B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen Image 2.1 viggle turbo v0.2.1 6step
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
LF
LFM2.5 2.6B Heretic Abliterated
Lfm · Abiray
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
ER
10Eros Max Turbo Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
ER
10Eros Max Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
GE
Gemory-26B-A4B-bf16
Gemory · Abiray
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
HE
Hemmingway 1 Heretic With Mtp Bf16
Hemmingway · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF

About Abiray on Hugging Face

Abiray has published 108 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Minimax. The most downloaded are MiniMax H3 Pruned, MiniMax H3 and DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS.

The quants Abiray publishes most often are Q4_K_M (98), Q5_K_M (86), Q6_K (85) and Q8_0 (80). Their Q4_K_M files range from 0.3 to 75.2 GB. Parameter counts run from 134M to 197B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has Abiray published?

108 models are listed here, mainly from the Qwen, Gemma and Minimax families. The most downloaded is MiniMax H3 Pruned.

Which quants does Abiray publish?

The most common are Q4_K_M (98 models), Q5_K_M (86 models), Q6_K (85 models) and Q8_0 (80 models).

Keep browsing