GGUF models by Abiray

108 GGUF models quantized by Abiray on Hugging Face. Sizes run from 134M to 197B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 27B AEON Ultimate Uncensored
Qwen · Abiray
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
OV
OvisOCR2
Ovisocr · Abiray
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen3.8 Flash Next Orca Abliterated GSQ RCO Coder
Qwen · Abiray
Params117B
Context256K
Smallest58.7 GB
CodingReasoningTool use
QW
Qwen Image 2.1 viggle turbo v0.3 6step
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
AR
Artemis 31B v1.2
Artemis · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
SE
SenseNova 6.8 Code2Video MTP
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
ReasoningTool useVision
QW
ComfyUI Qwen3 VL
Qwen · Abiray
Params8.77B
Context256K
Q4_K_M2.5 GB
Tool useVision
AN
Anima base v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
KR
Kroma v0.3.1 Turbo OPD
Kroma · Abiray
Params12.8B
Context—
Q4_K_M8.8 GB
GGUF
FL
flint 40B A2.5B Q4 K M
Flint · Abiray
Params39.8B
Context256K
Q4_K_M24.1 GB
ReasoningTool use
LT
LTX2.3 10Eros 1.4 Split
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
GGUF
FI
Fibo 2.0 edit turbo
Fibo · Abiray
Params8.23B
Context—
Q4_K_M5.3 GB
GGUF
HA
harrier oss v1 27b
Harrier · Abiray
Params27B
Context128K
Q4_K_M16.6 GB
Embedding
GE
Gemma 4 12B it AEON Abliterated K4
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
MI
Minimax h3 Singularity V2 Pruned
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
QW
Qwen3.5 4B Python Coder
Qwen · Abiray
Params4.2B
Context256K
Q4_K_M2.7 GB
Coding
SU
Sulphur 2 base
Sulphur · Abiray
Params21B
Context—
Q4_K_M14.3 GB
GGUF
QW
Qwen3.5 9B Abliterated Claude 4.6 Opus Reasoning Distilled v2
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
LT
LTX2.3 10Eros
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
GGUF
MI
Mistralai Shieldstral 1.0 3B
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
HU
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated
Huihui · Abiray
Params9.2B
Context1024K
Q4_K_M5.8 GB
ReasoningVision
GE
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
LT
LTX2.3 10Eros 1.3
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
GGUF
ER
10Eros Max
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
QW
Qwen3.6 35B A3B heretic
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
VI
Viggle Animate pruned
Viggle · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
ER
10Eros Max fl2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
AN
Anima turbo v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
MI
MiniMax Music3
Minimax · Abiray
Params2.46B
Context—
Q4_K_M1.5 GB
GGUF
OU
thesysdev_OUI 1
Oui · Abiray
Params25.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use

Keep browsing