GGUF models by Kaoeiri

70 GGUF models quantized by Kaoeiri on Hugging Face. Sizes run from 7.25B to 39B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
KE
Keiana-L3-Test6.2-8B-18
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
KE
Keiana-L3-Test5.2-8B-8
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
MA
MS Magpantheonsel lark v4x1.6.2 Cydonia vXXX 22B 5.5 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
HE
MS Magpantheonsel lark v5x1.8RP Cydonia vXXX 24B 12.2 Q4 K M
Hempantheonsel · Kaoeiri
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 7 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
KE
Keiana-L3-Test4.7-8B-3
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
QW
Qwenwify 32B v2.5 Q3 K M
Qwen · Kaoeiri
Params32.8B
Context128K
Smallest15.9 GB
GGUF
QW
Qwenwify 32B v4 Q3 K M
Qwen · Kaoeiri
Params32.8B
Context32K
Smallest15.9 GB
Tool use
MI
Mistral magnum_X_Cydonia v1.3
Mistral · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 9 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
AK
AkiroXEntro-7B-1-V1
Akiroxentro · Kaoeiri
Params7.25B
Context8K
Smallest5.1 GB
GGUF
IN
Interleaved upscale magnum v4 39B Q4 K S
Interleaved · Kaoeiri
Params39B
Context32K
Smallest22.2 GB
Tool use
KE
Keiana-L3-Test6.7-8B-23
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
GGUF
MA
MS MagpantheonselRP 22B 14.5 Precalculated Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonsel lark v4x1.6.2 Cydonia vXXX 22B 5 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MI
Mistral magnum v4 X Cydonia VXXX Max Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 8.5 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 10.11 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS MagpantheonselRP 22B 14.9 Omen Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 7.1 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MI
Mistral magnum v4 X Cydonia VXXX Mixture B Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
AK
AkiroXEntrou-4x7B
Akiroxentrou · Kaoeiri
Params24.2B
Context8K
Q4_K_M14.6 GB
GGUF
MI
Mistral magnum v4 X Cydonia VXXX Mixture C Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Mistral magnum v4 X Cydonia VXXX Mixture D Q4 K M
Mistral · Kaoeiri
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonse lark v4x1.6.2 Cydonia vXXX 22B 4 Q4 K M
Magpantheonse · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS MagpantheonselRP 22B 14 Test Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS MagpantheonselRP 22B 14.95 Omen Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 6 Q4 K M
Magpantheonsel · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS MagpantheonselRP 22B 12.95 Fictional Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
IN
MS Inky 2409 22B Q4 K M
Inky · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use

Keep browsing