GGUF models by Gille
57 GGUF models quantized by Gille on Hugging Face. Sizes run from 7.24B to 7.24B parameters. The longest trained context is 32K tokens.
About Gille on Hugging Face
Gille has published 57 GGUF models that ggufmodels.com tracks, across families such as Strangemerges and Strangerpercivaaled. The most downloaded are StrangeMerges 18 7B dare ties, StrangeMerges 17 7B dare ties and strangemerges 57 7b model stock.Q4 K M.
The quants Gille publishes most often are Q4_K_M (57) and Q5_K_M (1). Their Q4_K_M files range from 4.4 to 4.4 GB. Parameter counts run from 7.24B to 7.24B, and the longest trained context window is 32K tokens.
Frequently asked questions
What GGUF models has Gille published?
57 models are listed here, mainly from the Strangemerges and Strangerpercivaaled families. The most downloaded is StrangeMerges 18 7B dare ties.
Which quants does Gille publish?
The most common are Q4_K_M (57 models) and Q5_K_M (1 models).