GGUF models by kholiavko
134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.
LL
reception llama 3.1 8b test 8 1
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
reception 12 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 19 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 31 10
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reception llama 3.1 8b test 10 2 ep
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
reception 07 11 v2
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 5 2
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 8 4
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
reception 05 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reception llama 3.1 8b test 4 2
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 5
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 6 1
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 08 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 08 11 v3
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB