GGUF models by Abiray

108 GGUF models quantized by Abiray on Hugging Face. Sizes run from 134M to 197B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
QW
Huihui Qwen3.6 27B abliterated Q4 K M
Qwen · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
GE
Gemma 4 E4B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · Abiray
Params7.5B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplay
ER
10Eros Max ref2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
ZA
ZAYA1 8B
Zaya · Abiray
Params8.84B
Context128K
Q4_K_M5.6 GB
Reasoning
GE
gemma 4 E4B it OBLITERATED
Gemma · Abiray
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
MI
Huihui Ministral 3B Instruct 2512 abliterated
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · Abiray
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
MI
MiniCPM5 1B
MiniCPM · Abiray
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
AN
Anima aesthetic v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
MU
Muse Glimmer 30B
Muse · Abiray
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest24.7 GB
ReasoningTool useVision
FA
Fara1.5 27B
Fara · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.5 9B Abliterated Claude 4.6 Opus Reasoning Distilled
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3.6 35B A3B heretic Q4 K M
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
CodingReasoningTool use
LA
Lance 3B Video
Lance · Abiray
Params6.44B
Context—
Q4_K_M5.0 GB
GGUF
SU
supergemma4 e4b abliterated
Supergemma · Abiray
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest16.8 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest19.9 GB
ReasoningTool useVision
GE
Gemma 4 31B It Claude Opus Distill
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
NA
Nanbeige4.2 3B
Nanbeige · Abiray
Params4.17B
Context256K
Q4_K_M2.6 GB
CodingReasoningTool use
QW
Qwen3.5 2B heretic
Qwen · Abiray
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen3.6 27B Heretic ARA
Qwen · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Smallest36.9 GB
ReasoningTool useVision
GE
Gemma 4 E4B Gemini 3.1 Pro Reasoning Distill v2 Merged
Gemma · Abiray
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
ID
ideogram 4
Ideogram · Abiray
Params9.28B
Context—
Smallest5.6 GB
GGUF
QI
Qianfan OCR
Qianfan · Abiray
Params4.42B
Context32K
Q4_K_M2.7 GB
ReasoningTool useVision
HO
K2 Horizon MoVA 36B A4B
Horizon · Abiray
Params37.4B
Context512K
Q4_K_M22.4 GB
ReasoningTool use
HU
Huihui Qwopus3.5 4B v3 abliterated
Huihui · Abiray
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision

Keep browsing