GGUF models by PrunaAI
95 GGUF models quantized by PrunaAI on Hugging Face. Sizes run from 10M to 141B parameters. The longest trained context is 1024K tokens.
About PrunaAI on Hugging Face
PrunaAI has published 95 GGUF models that ggufmodels.com tracks, across families such as Llama, Phi and Qwen. The most downloaded are Phi 3 mini 4k instruct GGUF Imatrix smashed, Phi 3 mini 128k instruct GGUF Imatrix smashed and zephyr orpo 141b A35b v0.1 GGUF smashed.
The quants PrunaAI publishes most often are Q5_K_M (95), Q4_K_S (95), Q3_K_S (95) and Q3_K_M (95). Their Q4_K_M files range from 0.0 to 85.6 GB. Parameter counts run from 10M to 141B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has PrunaAI published?
95 models are listed here, mainly from the Llama, Phi and Qwen families. The most downloaded is Phi 3 mini 4k instruct GGUF Imatrix smashed.
Which quants does PrunaAI publish?
The most common are Q5_K_M (95 models), Q4_K_S (95 models), Q3_K_S (95 models) and Q3_K_M (95 models).