Hunyuan GGUF models

85 GGUF models in the Hunyuan family, quantized by 40 uploaders. Sizes run from 539M to 80.4B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HU
Hunyuan MT 7B
Hunyuan · notcaleb
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan 0.5B Instruct
Hunyuan · Disya
Params539M
Context256K
Smallest0.6 GB
ReasoningTool use
HU
Hunyuan A13B Instruct
Hunyuan · ubergarm
Params80.4B
Context256K
Smallest36.6 GB
ReasoningTool use
HU
hunyuan dating bundle
Hunyuan · Nikula8
Params11.9B
Context—
Smallest12.7 GB
GGUF
HU
Hunyuan MT Chimera 7B
Hunyuan · imikeliu
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan 7B Instruct
Hunyuan · Edge-Quant
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan 1.8B Instruct
Hunyuan · Disya
Params1.79B
Context256K
Smallest1.9 GB
ReasoningTool use
HU
Hunyuan MT 7B
Hunyuan · RoadToNowhere
Params7.5B
Context256K
Smallest15.0 GB
GGUF
HU
Hunyuan 1.8B Instruct
Hunyuan · Edge-Quant
Params1.79B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
HU
Hunyuan 0.5B Instruct
Hunyuan · Edge-Quant
Params539M
Context256K
Smallest0.6 GB
ReasoningTool use
HU
Hunyuan 1.8B Instruct
Hunyuan · NikolayKozloff
Params1.79B
Context256K
Smallest1.9 GB
ReasoningTool use
HU
Hunyuan 0.5B Instruct
Hunyuan · NikolayKozloff
Params539M
Context256K
Smallest0.6 GB
ReasoningTool use
HU
Hunyuan MT 7B
Hunyuan · Sangto
Params7.5B
Context256K
Smallest8.0 GB
GGUF
HU
Hunyuan MT Chimera 7B
Hunyuan · KnutJaegersberg
Params7.5B
Context256K
Smallest8.0 GB
GGUF
HU
Hunyuan 4B Instruct
Hunyuan · Disya
Params4.22B
Context256K
Smallest4.5 GB
ReasoningTool use
HU
Hunyuan MT 7B
Hunyuan · weege007
Params7.5B
Context256K
Smallest3.0 GB
GGUF
HU
Hunyuan MT 7B
Hunyuan · RKNNAI
Params7B
Context32K
Smallest0.0 GB
GGUF
HU
Hunyuan 4B Instruct
Hunyuan · Edge-Quant
Params4.22B
Context256K
Q4_K_M2.6 GB
ReasoningTool use
HU
Hunyuan 1.8B Instruct
Hunyuan · tooltd
Params1.79B
Context256K
Smallest1.9 GB
ReasoningTool use
HU
Hunyuan MT 7B
Hunyuan · ZDThunder
Params7.5B
Context256K
Smallest8.0 GB
GGUF
HU
Hunyuan MT 7B
Hunyuan · ShawnNTU
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan 4B Instruct
Hunyuan · NikolayKozloff
Params4.22B
Context256K
Smallest4.5 GB
ReasoningTool use
HU
Hunyuan 4B Instruct
Hunyuan · F-urkan
Params4.22B
Context256K
Q4_K_M2.6 GB
ReasoningTool use
HU
Hunyuan-A13B-Instruct
Hunyuan · Face314
Params80.4B
Context256K
Smallest44.4 GB
ReasoningTool use
HU
Hunyuan 0.5B Instruct
Hunyuan · RonKigen
Params539M
Context256K
Smallest0.6 GB
ReasoningTool use

Keep browsing