GGUF models by kholiavko
134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.
LL
streaming 25 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception llama 3.2 test 1
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
RE
reception 29 11 2epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
streaming 30 01
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception llama 3.2 3b test 2
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
LL
reception 12 19 6ep old struct
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
QW
test ds 7b
Qwen · kholiavko
Params7.62B
Context32K
Smallest8.1 GB
LL
Streaming 28 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
MI
Ministral 8B Test v1
Mistral · kholiavko
Params8.02B
Context32K
Smallest5.7 GB
MI
Ministral 8B Test New Template
Mistral · kholiavko
Params8.02B
Context32K
Smallest16.0 GB
RE
reception 05 12 1 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
streaming 19 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
GE
reception gemma 9b 22 10
Gemma · kholiavko
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Ministral 8B Test 4bitt
Mistral · kholiavko
Params8.02B
Context32K
Smallest5.7 GB
LL
Streaming 20 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception llama 3.1 8b test 5 4
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception test 16bit
Llama · kholiavko
Params8.03B
Context128K
Smallest16.1 GB
LL
streaming 06 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
MI
Streaming Mistral 7b 25 06
Mistral · kholiavko
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
reception llama 3.1 8b test 7 1
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 6 4
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.2 3b test 3
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
LL
Streaming 26 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception llama 3.1 8b test 8 3
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
reception 01 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Streaming 08 06
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
test gemma 9b 24 10
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
LL
Streaming 24 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception test 8bit Q8 0
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
TE
test train on responses gguf 2 epochs
Test · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB