GGUF models by sheldonrobinson
37 GGUF models quantized by sheldonrobinson on Hugging Face. Sizes run from 23M to 41.9B parameters. The longest trained context is 128K tokens.
About sheldonrobinson on Hugging Face
sheldonrobinson has published 37 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Llama. The most downloaded are Qwen2.5 Coder 1.5B Instruct, TEN_Turn_Detection and Qwen2.5 Math 1.5B Instruct.
The quants sheldonrobinson publishes most often are Q8_0 (17), Q4_K_M (17) and Q4_0 (3). Their Q4_K_M files range from 0.0 to 25.3 GB. Parameter counts run from 23M to 41.9B, and the longest trained context window is 128K tokens.
Frequently asked questions
What GGUF models has sheldonrobinson published?
37 models are listed here, mainly from the Qwen, Gemma and Llama families. The most downloaded is Qwen2.5 Coder 1.5B Instruct.
Which quants does sheldonrobinson publish?
The most common are Q8_0 (17 models), Q4_K_M (17 models) and Q4_0 (3 models).