GGUF models by Kaoeiri
70 GGUF models quantized by Kaoeiri on Hugging Face. Sizes run from 7.25B to 39B parameters. The longest trained context is 128K tokens.
MI
Mistral magnum v4 X Cydonia VXXX Mixture Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
KE
Keiana-L3-Test6.1-8B-17
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 7.2 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
KE
Keiana L3 Test4.6 8B 2
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
MA
L3MaidRPKraiKei-V1.6-8B
Maidrpkraikei · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
MA
MS MagpantheonselRP 22B 12.99 Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS MagpantheonselRP 22B 14.1 Recalculated Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
L3MaidRPKraiKei-V1.65-8B
Maidrpkraikei · Kaoeiri
Params8.03B
Context8K
Smallest4.7 GB
MA
MS MagpantheonselRP 22B 12.9 Fictional Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
KE
Keiana L3 Test5.4 8B 10 Q6 K
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB