GGUF models by kholiavko

134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
reception llama 3.1 8b test 8 1
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
reception 12 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
RE
reception 19 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
RE
reception 31 10
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
reception llama 3.1 8b test 10 2 ep
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
reception 07 11 v2
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
reception llama 3.1 8b test 5 2
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
reception llama 3.1 8b test 8 4
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RE
reception 05 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
reception llama 3.1 8b test 4 2
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
reception llama 3.1 8b test 5
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
reception llama 3.1 8b test 6 1
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
RE
reception 08 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
RE
reception 08 11 v3
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use

Keep browsing