GGUF models by tsunemoto
37 GGUF models quantized by tsunemoto on Hugging Face. Sizes run from 462M to 69B parameters. The longest trained context is 32K tokens.
NE
NexoNimbus 7B
Nexonimbus · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Senku 70B Full
Senku · tsunemoto
Params69B
Context32K
Q4_K_M41.4 GB
ME
Metis 0.4
Metis · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 1.5 6B Chat
Yi · tsunemoto
Params6.06B
Context4K
Q4_K_M3.7 GB
BA
bagel dpo 7b v0.1
Bagel · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
AM
AmberChat
Amberchat · tsunemoto
Params6.74B
Context2K
Q4_K_M4.1 GB
OP
openchat 3.5
Openchat · tsunemoto
Params7.24B
Context8K
Q4_K_M4.4 GB