GGUF models by kainatq

34 GGUF models quantized by kainatq on Hugging Face. Sizes run from 7.24B to 14.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
RP King 12b
King · kainatq
Params12.2B
Context1000K
Smallest6.6 GB
Roleplay
AL
AllKingsRoleplay_12b_v1
Allkingsroleplay · kainatq
Params12.2B
Context128K
Smallest6.6 GB
Roleplay
OM
KQ_Omni 12B v1
Omni · kainatq
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KI
KingOmini_14b_v1
Kingomini · kainatq
Params14.8B
Context32K
Smallest7.3 GB
Tool use

Keep browsing