GGUF models by kholiavko

134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
test gemma
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
reception llama 3.1 8b test
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
reception llama 3.1 8b test 4 train on responses only
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
test gemma 9b 24 10 chatml dataset
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
test streaming responses mixed
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
RE
reception 19 11 responses 4 epoch
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
streaming 29 01
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
TE
test train on responses gguf 3b 3 epochs
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
test streaming responses mixed 6ep
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception llama 3.1 8b test 10
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
streaming 05 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
streaming 19 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception 12 13 6ep old struct
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception 12 07 test
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
reception 12 06 v3 test
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MI
18 07 Ministral 8b
Mistral · kholiavko
Params8.02B
Context32K
Smallest16.0 GB
GGUF
TE
test train on responses
Test · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
reception llama 3.2 3b test 1
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
GGUF
GE
test gemma new new
Gemma · kholiavko
Params2.51B
Context8K
Smallest2.7 GB
GGUF
LL
test streaming responses
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
streaming 17 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
streaming 12 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
GE
test gemma 9b 25 10 train
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
reception 12 07 2ep old struct
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
reception llama 3.1 8b test 8 2
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Ministral 8B 24 08 25
Mistral · kholiavko
Params8.02B
Context32K
Smallest8.5 GB
GGUF
TE
test ds 1 5
Test · kholiavko
Params1.78B
Context128K
Smallest1.3 GB
Tool use
LL
streaming 11 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
streaming 13 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception llama 3.1 8b test 9 3
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing