GGUF models by afrideva
183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.
About afrideva on Hugging Face
afrideva has published 183 GGUF models that ggufmodels.com tracks, across families such as Llama, Tinyllama and Phi. The most downloaded are Tinystories-gpt-0.1-3m, TinyMistral 248M and LocutusqueXFelladrin TinyMistral248M Instruct.
The quants afrideva publishes most often are Q6_K (183), Q5_K_M (183), Q4_K_M (183) and Q2_K (183). Their Q4_K_M files range from 0.0 to 5.3 GB. Parameter counts run from 2M to 8.83B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has afrideva published?
183 models are listed here, mainly from the Llama, Tinyllama and Phi families. The most downloaded is Tinystories-gpt-0.1-3m.
Which quants does afrideva publish?
The most common are Q6_K (183 models), Q5_K_M (183 models), Q4_K_M (183 models) and Q2_K (183 models).