GGUF models by paultimothymooney
39 GGUF models quantized by paultimothymooney on Hugging Face. Sizes run from 494M to 32.8B parameters. The longest trained context is 128K tokens.
About paultimothymooney on Hugging Face
paultimothymooney has published 39 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Mistral. The most downloaded are Qwen2.5 7B Instruct, Llama 3.2 3B Instruct and Qwen2.5 7B Instruct.
The quants paultimothymooney publishes most often are Q8_0 (25), Q4_K_M (13) and Q5_0 (1). Their Q4_K_M files range from 2.0 to 16.6 GB. Parameter counts run from 494M to 32.8B, and the longest trained context window is 128K tokens.
Frequently asked questions
What GGUF models has paultimothymooney published?
39 models are listed here, mainly from the Qwen, Gemma and Mistral families. The most downloaded is Qwen2.5 7B Instruct.
Which quants does paultimothymooney publish?
The most common are Q8_0 (25 models), Q4_K_M (13 models) and Q5_0 (1 models).