GGUF models by Kaoeiri

70 GGUF models quantized by Kaoeiri on Hugging Face. Sizes run from 7.25B to 39B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral magnum v4 X Cydonia VXXX Mixture Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
KE
Keiana-L3-Test6.1-8B-17
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 7.2 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
KE
Keiana L3 Test4.6 8B 2
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
GGUF
MA
L3MaidRPKraiKei-V1.6-8B
Maidrpkraikei · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
GGUF
MA
MS MagpantheonselRP 22B 12.99 Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS MagpantheonselRP 22B 14.1 Recalculated Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
L3MaidRPKraiKei-V1.65-8B
Maidrpkraikei · Kaoeiri
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MA
MS MagpantheonselRP 22B 12.9 Fictional Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
KE
Keiana L3 Test5.4 8B 10 Q6 K
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF

Keep browsing