GGUF models by Kaoeiri
70 GGUF models quantized by Kaoeiri on Hugging Face. Sizes run from 7.25B to 39B parameters. The longest trained context is 128K tokens.
KE
Keiana-L3-Test6.2-8B-18
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
KE
Keiana-L3-Test5.2-8B-8
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
MA
MS Magpantheonsel lark v4x1.6.2 Cydonia vXXX 22B 5.5 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
HE
MS Magpantheonsel lark v5x1.8RP Cydonia vXXX 24B 12.2 Q4 K M
Hempantheonsel · Kaoeiri
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 7 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
KE
Keiana-L3-Test4.7-8B-3
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
QW
Qwenwify 32B v2.5 Q3 K M
Qwen · Kaoeiri
Params32.8B
Context128K
Smallest15.9 GB
QW
Qwenwify 32B v4 Q3 K M
Qwen · Kaoeiri
Params32.8B
Context32K
Smallest15.9 GB
MI
Mistral magnum_X_Cydonia v1.3
Mistral · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 9 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
AK
AkiroXEntro-7B-1-V1
Akiroxentro · Kaoeiri
Params7.25B
Context8K
Smallest5.1 GB
IN
Interleaved upscale magnum v4 39B Q4 K S
Interleaved · Kaoeiri
Params39B
Context32K
Smallest22.2 GB
KE
Keiana-L3-Test6.7-8B-23
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
MA
MS MagpantheonselRP 22B 14.5 Precalculated Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS Magpantheonsel lark v4x1.6.2 Cydonia vXXX 22B 5 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
Mistral magnum v4 X Cydonia VXXX Max Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 8.5 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 10.11 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS MagpantheonselRP 22B 14.9 Omen Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 7.1 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
Mistral magnum v4 X Cydonia VXXX Mixture B Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
AK
AkiroXEntrou-4x7B
Akiroxentrou · Kaoeiri
Params24.2B
Context8K
Q4_K_M14.6 GB
MI
Mistral magnum v4 X Cydonia VXXX Mixture C Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral magnum v4 X Cydonia VXXX Mixture D Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
MS Magpantheonse lark v4x1.6.2 Cydonia vXXX 22B 4 Q4 K M
Magpantheonse · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS MagpantheonselRP 22B 14 Test Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS MagpantheonselRP 22B 14.95 Omen Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 6 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS MagpantheonselRP 22B 12.95 Fictional Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
IN
MS Inky 2409 22B Q4 K M
Inky · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB