GGUF models by kholiavko

134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
streaming 25 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception llama 3.2 test 1
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
Tool use
RE
reception 29 11 2epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
streaming 30 01
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception llama 3.2 3b test 2
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
GGUF
LL
reception 12 19 6ep old struct
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
QW
test ds 7b
Qwen · kholiavko
Params7.62B
Context32K
Smallest8.1 GB
Tool use
LL
Streaming 28 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
MI
Ministral 8B Test v1
Mistral · kholiavko
Params8.02B
Context32K
Smallest5.7 GB
GGUF
MI
Ministral 8B Test New Template
Mistral · kholiavko
Params8.02B
Context32K
Smallest16.0 GB
GGUF
RE
reception 05 12 1 epochs
Reception · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
streaming 19 03
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
GE
reception gemma 9b 22 10
Gemma · kholiavko
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Ministral 8B Test 4bitt
Mistral · kholiavko
Params8.02B
Context32K
Smallest5.7 GB
GGUF
LL
Streaming 20 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception llama 3.1 8b test 5 4
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
reception test 16bit
Llama · kholiavko
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
streaming 06 02
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
MI
Streaming Mistral 7b 25 06
Mistral · kholiavko
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
reception llama 3.1 8b test 7 1
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
reception llama 3.1 8b test 6 4
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
reception llama 3.2 3b test 3
Llama · kholiavko
Params3.21B
Context128K
Smallest3.4 GB
GGUF
LL
Streaming 26 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception llama 3.1 8b test 8 3
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RE
reception 01 11
Reception · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Streaming 08 06
Llama · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
test gemma 9b 24 10
Gemma · kholiavko
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
Streaming 24 05
Llama · kholiavko
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
reception test 8bit Q8 0
Llama · kholiavko
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TE
test train on responses gguf 2 epochs
Test · kholiavko
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing