GGUF models by tsunemoto
37 GGUF models quantized by tsunemoto on Hugging Face. Sizes run from 462M to 69B parameters. The longest trained context is 32K tokens.
About tsunemoto on Hugging Face
tsunemoto has published 37 GGUF models that ggufmodels.com tracks, across families such as Yi, Mistral and Heimer. The most downloaded are MiniChat 1.5 3B, Mistral 7B Instruct v0.2 and TinyDolphin 2.8 1.1b.
The quants tsunemoto publishes most often are Q5_K_M (37), Q4_K_M (37), Q5_K_S (36) and Q4_K_S (36). Their Q4_K_M files range from 0.3 to 41.4 GB. Parameter counts run from 462M to 69B, and the longest trained context window is 32K tokens.
Frequently asked questions
What GGUF models has tsunemoto published?
37 models are listed here, mainly from the Yi, Mistral and Heimer families. The most downloaded is MiniChat 1.5 3B.
Which quants does tsunemoto publish?
The most common are Q5_K_M (37 models), Q4_K_M (37 models), Q5_K_S (36 models) and Q4_K_S (36 models).