Huihui GGUF models

202 GGUF models in the Huihui family, quantized by 45 uploaders. Sizes run from 447M to 72.7B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HU
Cyber Tiel Coder 35B A3B GGUF MTP
Huihui · peculiar-ragdoll
Params35.5B
Context256K
Q4_K_M22.5 GB
CodingReasoningTool use
HU
Cyber Tiel Coder 35B A3B
Huihui · peculiar-ragdoll
Params34.7B
Context256K
Q4_K_M22.1 GB
CodingReasoningTool use
HU
Huihui4 8B A4B
Huihui · huihui-ai
Params8.1B
Context256K
Smallest5.4 GB
Vision
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
HU
Ornith 1.5 35B A3B Abliterated
Huihui · ArtomYuan
Params35.5B
Context256K
Smallest19.0 GB
Vision
HU
Ornith 1.5 35B A3B Abliterated CyberTiel Calibrated MTPv2 ICE
Huihui · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GGUF
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
HU
Huihui Hunyuan MT 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Huihui OmniCoder 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Coding
HU
Huihui CyberStrike OffSec 35B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Tool useVision
HU
Huihui Agents A1 Abliterated
Huihui · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
HU
Huihui3.5 67B A3B Abliterated
Huihui · mradermacher
Params67B
Context256K
Q4_K_M40.8 GB
GGUF
HU
Xing4.0 29B A4B APEX I MiniPlus V2.1 Abliterated
Huihui · IsValorum
Params31.2B
Context256K
Smallest13.8 GB
Reasoning
HU
Huihui3.5 67B A3B APEX
Huihui · mudler
Params67B
Context256K
Smallest27.3 GB
GGUF
HU
Huihui HY MT1.5 1.8B Abliterated
Huihui · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
HU
Huihui Qwopus3.5 9B v3 Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
HU
Huihui Hunyuan MT Chimera 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Huihui4 8B A4B v2
Huihui · mradermacher
Params8.1B
Context256K
Q4_K_M5.4 GB
GGUF
HU
Huihui Qwopus3.5 9B v3 Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
HU
Huihui4 48B A4B Abliterated
Huihui · mradermacher
Params48B
Context256K
Q4_K_M32.0 GB
GGUF
HU
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated
Huihui · Abiray
Params9.2B
Context1024K
Q4_K_M5.8 GB
ReasoningVision
HU
Huihui HY MT1.5 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Huihui OmniCoder 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
HU
Huihui MiroThinker v1.5 30B Abliterated
Huihui · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
HU
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated
Huihui · mradermacher
Params9.2B
Context1024K
Q4_K_M5.8 GB
ReasoningTool use
HU
Huihui NeoHorse 1 4B Abliterated
Huihui · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use

About the Huihui GGUF models

Huihui is represented on ggufmodels.com by 202 GGUF models, quantized by 45 uploaders on Hugging Face. The most downloaded are Cyber Tiel Coder 35B A3B GGUF MTP, Cyber Tiel Coder 35B A3B and Huihui4 8B A4B. Parameter counts run from 447M to 72.7B, and the longest trained context window is 1024K tokens.

A Q4_K_M file of a Huihui model is between 0.6 to 47.4 GB, which is the quant most people start with. Most files come from mradermacher (109), noctrex (13) and Manojb (12). The quants you will meet most often are Q4_K_M (152), Q6_K (139), Q5_K_M (135) and Q3_K_M (133), where the number is how many models offer that quant.

Frequently asked questions

Which Huihui GGUF should I download?

The most downloaded Huihui GGUF here is Cyber Tiel Coder 35B A3B GGUF MTP. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Huihui model need?

Q4_K_M files of Huihui models on this site range from 0.6 to 47.4 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Huihui GGUF files come from?

The most common quantizers here are mradermacher, noctrex and Manojb. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing