GGUF models by kholiavko
134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.
GE
test gemma
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
LL
reception llama 3.1 8b test
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reception llama 3.1 8b test 4 train on responses only
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
test gemma 9b 24 10 chatml dataset
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
LL
test streaming responses mixed
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
RE
reception 19 11 responses 4 epoch
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
streaming 29 01
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
TE
test train on responses gguf 3b 3 epochs
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
test streaming responses mixed 6ep
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception llama 3.1 8b test 10
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
streaming 05 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
streaming 19 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception 12 13 6ep old struct
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception 12 07 test
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception 12 06 v3 test
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
MI
18 07 Ministral 8b
Mistral · kholiavko
Params8.02B
Context32K
Smallest16.0 GB
TE
test train on responses
Test · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reception llama 3.2 3b test 1
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
GE
test gemma new new
Gemma · kholiavko
Params2.51B
Context8K
Smallest2.7 GB
LL
test streaming responses
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
streaming 17 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
streaming 12 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
GE
test gemma 9b 25 10 train
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
LL
reception 12 07 2ep old struct
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
LL
reception llama 3.1 8b test 8 2
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Ministral 8B 24 08 25
Mistral · kholiavko
Params8.02B
Context32K
Smallest8.5 GB
TE
test ds 1 5
Test · kholiavko
Params1.78B
Context128K
Smallest1.3 GB
LL
streaming 11 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
streaming 13 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
LL
reception llama 3.1 8b test 9 3
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB