GGUF models by kainatq
34 GGUF models quantized by kainatq on Hugging Face. Sizes run from 7.24B to 14.8B parameters. The longest trained context is 1000K tokens.
KI
RP King 12b
King · kainatq
Params12.2B
Context1000K
Smallest6.6 GB
AL
AllKingsRoleplay_12b_v1
Allkingsroleplay · kainatq
Params12.2B
Context128K
Smallest6.6 GB
OM
KQ_Omni 12B v1
Omni · kainatq
Params12.2B
Context1000K
Q4_K_M7.5 GB
KI
KingOmini_14b_v1
Kingomini · kainatq
Params14.8B
Context32K
Smallest7.3 GB