GGUF models by kholiavko
134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.
RE
reception nemo test 1
Reception · kholiavko
Params12.2B
Context1000K
Smallest13.0 GB
LL
reception llama 3.1 8b test 6 3
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
TE
test train on responses gguf 3b
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
RE
reception 06 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
streaming 13 01
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
GE
test gemma new
Gemma · kholiavko
Params2.51B
Context8K
Q4_K_M1.6 GB
RE
reception 22 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 19 11 responses 6 epoch
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 9 1
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reception llama 3.1 8b test 9
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reception llama 3.1 8b test 5 5
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 29 11 5 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 5 3
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 14 11 2 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 08 11 v2
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 9 2
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
reception 19 11 responses
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 29 11 5 5 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
Streaming 27 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
RE
reception 22 11 4epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
QW
Qwen3 8b Test
Qwen · kholiavko
Params8.19B
Context40K
Q4_K_M5.0 GB
TE
test train on responses gguf 3b 2 epochs
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
RE
reception 04 12 3 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 5 1
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
LL
reception llama 3.1 8b test 8 5
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
reception 07 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
streaming 05 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception llama 3.1 8b test 6 2
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 05 12 v2 2 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
RE
reception 03 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB