Hunyuan GGUF models

85 GGUF models in the Hunyuan family, quantized by 40 uploaders. Sizes run from 539M to 80.4B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HU
Hunyuan 1.8B Instruct
Hunyuan · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
HU
Hunyuan 0.5B Instruct Raw
Hunyuan · Fu01978
Params539M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
HU
Hunyuan A13B Instruct
Hunyuan · lmstudio-community
Params80.4B
Context256K
Q4_K_M49.3 GB
ReasoningTool use
HU
Hunyuan-7B-Instruct
Hunyuan · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
GGUF
HU
hy3d
Hunyuan · king5699
Params1.11B
Context—
Q4_K_M0.6 GB
GGUF
HU
Hunyuan 1.8B Instruct
Hunyuan · gabriellarson
Params1.79B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
HU
tencent.Hunyuan A13B Instruct
Hunyuan · DevQuasar
Params80.4B
Context256K
Q4_K_M48.8 GB
ReasoningTool use
HU
tencent.Hunyuan 7B Instruct
Hunyuan · DevQuasar
Params7.5B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
HU
Hunyuan 7B Instruct
Hunyuan · ZeroWw
Params7.5B
Context256K
Smallest4.7 GB
ReasoningTool use
HU
Hunyuan 7B Instruct
Hunyuan · gabriellarson
Params7.5B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
HU
Hunyuan 0.5B Instruct
Hunyuan · gabriellarson
Params539M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
HU
Hunyuan MT 7B
Hunyuan · imikeliu
Params7.5B
Context256K
Smallest8.0 GB
GGUF
HU
Hunyuan A13B Instruct Hf
Hunyuan · bullerwins
Params80.4B
Context256K
Q4_K_M48.8 GB
ReasoningTool use
HU
tencent.Hunyuan MT 7B
Hunyuan · DevQuasar
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan A13B Pretrain
Hunyuan · mradermacher
Params80.4B
Context256K
Q4_K_M48.8 GB
GGUF
HU
Hunyuan 0.5B Pretrain
Hunyuan · mradermacher
Params539M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
HU
Hunyuan 1.8B Instruct
Hunyuan · Dzluck
Params1.79B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
HU
Hunyuan MT 7B simul et en ru uk
Hunyuan · TalTechNLP
Params7.5B
Context256K
Smallest4.6 GB
GGUF
HU
tencent.Hunyuan 4B Instruct
Hunyuan · DevQuasar
Params4.22B
Context256K
Q4_K_M2.6 GB
ReasoningTool use
HU
Hunyuan-MT-Chimera-7B
Hunyuan · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
GGUF
HU
tencent.Hunyuan 0.5B Instruct
Hunyuan · DevQuasar
Params539M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
HU
Hunyuan A13B Instruct
Hunyuan · mradermacher
Params80.4B
Context256K
Q4_K_M48.8 GB
ReasoningTool use
HU
tencent.Hunyuan MT Chimera 7B
Hunyuan · DevQuasar
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan MT Chimera 7B
Hunyuan · NikolayKozloff
Params7.5B
Context256K
Smallest8.0 GB
GGUF
HU
Hunyuan MT 7B
Hunyuan · wszgrcy
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan MT Chimera 7B
Hunyuan · wqerrewetw
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan A13B Pretrain
Hunyuan · mradermacher
Params80.4B
Context256K
Q4_K_M48.8 GB
GGUF
HU
Hunyuan 0.5B Pretrain
Hunyuan · mradermacher
Params539M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
HU
Hunyuan MT Chimera 7B
Hunyuan · wszgrcy
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
Hunyuan A13B Instruct
Hunyuan · redponike
Params80.4B
Context256K
Q4_K_M48.8 GB
ReasoningTool use

Keep browsing