GGUF models by AIgotahole

38 GGUF models quantized by AIgotahole on Hugging Face. Sizes run from 4.62B to 26.1B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 14B Abliterated
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use
OL
Olmo 3 1025 7B Stage1 Step1413814
OLMo · AIgotahole
Params7.3B
Context16K
Smallest5.2 GB
GGUF
GL
Huihui GLM 4.1V 9B Thinking Abliterated
GLM · AIgotahole
Params9.4B
Context64K
Smallest6.7 GB
ReasoningVision
QW
Gprmax Ft Qwen3 8B Instruct
Qwen · AIgotahole
Params8.19B
Context40K
Smallest5.9 GB
ReasoningTool use
LL
Llama3.1 8B ARPO
Llama · AIgotahole
Params8.03B
Context128K
Smallest5.7 GB
Tool use
QW
Qwen2.5 14B Instruct CARE
Qwen · AIgotahole
Params14.8B
Context32K
Smallest8.6 GB
GGUF
QU
Queen 2.5 14B aka Q4 K S
Queen · AIgotahole
Params14.8B
Context128K
Smallest8.6 GB
GGUF
MI
red teamer mistral nemo Q4 K M
Mistral · AIgotahole
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
Qwen3 14b Sft Merged
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
GGUF
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v1 12B
Gemma · AIgotahole
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
SA
SAIL VL2 8B
Sail · AIgotahole
Params8.19B
Context40K
Smallest5.9 GB
GGUF
GL
Glyph Q4 K M
Glyph · AIgotahole
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
QW
Qwen3 8B Medmcqa GrayLine
Qwen · AIgotahole
Params8.19B
Context40K
Smallest5.9 GB
ReasoningTool use
SI
SearchSimulation 14B Q4 K M
Simulation · AIgotahole
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
A0
A0s 12B
AIgotahole
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AE
Aepo_Light
Aepo · AIgotahole
Params7.62B
Context32K
Smallest5.4 GB
Tool use
FA
Father Teacher
Father · AIgotahole
Params8.19B
Context40K
Smallest5.9 GB
GGUF
QW
Qwen3 8b Dabstep Reasoning 108 Fixed Reasoning Sharegpt Sft
Qwen · AIgotahole
Params8.19B
Context40K
Smallest5.9 GB
Reasoning
QW
Qwen3 14B Shadow FT BAAI 2k
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use
AF
AFM 4.5B Base Pre Anneal
Afm · AIgotahole
Params4.62B
Context4K
Smallest3.8 GB
GGUF
QW
Qwen3 8B Shadow FT BAAI 2k
Qwen · AIgotahole
Params8.19B
Context40K
Smallest5.9 GB
ReasoningTool use
SE
SenseNova SI InternVL3 8B
Sensenova · AIgotahole
Params7.61B
Context32K
Smallest5.4 GB
GGUF
IN
Stellaris internlm2 20b r512 Q4 K S
InternLM · AIgotahole
Params19.9B
Context32K
Smallest11.4 GB
GGUF
GE
Gemma 2 9b It MoAA DPO
Gemma · AIgotahole
Params9.24B
Context8K
Smallest6.5 GB
GGUF
YI
Yi 9B Petma afk Q5 K S
Yi · AIgotahole
Params8.83B
Context4K
Smallest6.1 GB
GGUF
GE
Gewwa 2 9B wtf Q5 K S
Gewwa · AIgotahole
Params9.24B
Context8K
Smallest6.5 GB
GGUF
MI
Minor Repo 12B omg Q4 K M
Minor · AIgotahole
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TR
Trinity Mini FP8 Block
Trinity · AIgotahole
Params26.1B
Context128K
Q4_K_M15.8 GB
GGUF
FR
FranFran Something 12B
Franfran · AIgotahole
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
VeriThoughts Reasoning 14B Qwen3
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use

About AIgotahole on Hugging Face

AIgotahole has published 38 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and GLM. The most downloaded are Qwen3 14B Abliterated, Olmo 3 1025 7B Stage1 Step1413814 and Huihui GLM 4.1V 9B Thinking Abliterated.

The quants AIgotahole publishes most often are Q5_K_M (12), Q4_K_S (11), Q4_K_M (8) and Q5_K_S (6). Their Q4_K_M files range from 6.2 to 15.8 GB. Parameter counts run from 4.62B to 26.1B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has AIgotahole published?

38 models are listed here, mainly from the Qwen, Gemma and GLM families. The most downloaded is Qwen3 14B Abliterated.

Which quants does AIgotahole publish?

The most common are Q5_K_M (12 models), Q4_K_S (11 models), Q4_K_M (8 models) and Q5_K_S (6 models).

Keep browsing