GGUF models by kholiavko

134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
RE
reception nemo test 1
Reception · kholiavko
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
LL
reception llama 3.1 8b test 6 3
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
test train on responses gguf 3b
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
RE
reception 06 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
streaming 13 01
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
GE
test gemma new
Gemma · kholiavko
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
RE
reception 22 11
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
RE
reception 19 11 responses 6 epoch
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
reception llama 3.1 8b test 9 1
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
reception llama 3.1 8b test 9
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
reception llama 3.1 8b test 5 5
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
RE
reception 29 11 5 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
reception llama 3.1 8b test 5 3
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
RE
reception 14 11 2 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
RE
reception 08 11 v2
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
reception llama 3.1 8b test 9 2
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
reception 19 11 responses
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
RE
reception 29 11 5 5 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Streaming 27 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
RE
reception 22 11 4epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
QW
Qwen3 8b Test
Qwen · kholiavko
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
TE
test train on responses gguf 3b 2 epochs
Test · kholiavko
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
RE
reception 04 12 3 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
reception llama 3.1 8b test 5 1
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
reception llama 3.1 8b test 8 5
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RE
reception 07 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
streaming 05 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception llama 3.1 8b test 6 2
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
RE
reception 05 12 v2 2 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
RE
reception 03 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing