GGUF models by PrunaAI
95 GGUF models quantized by PrunaAI on Hugging Face. Sizes run from 10M to 141B parameters. The longest trained context is 1024K tokens.
LL
ajibawa 2023 Code Llama 3 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
huggyllama llama 7b GGUF smashed
Llama · PrunaAI
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
dolphin 2.9 llama3 8b 1m GGUF smashed
Llama · PrunaAI
Params8.03B
Context1024K
Q4_K_M4.9 GB
FI
T5 Small
Finetune · PrunaAI
Params61M
Context512
Q4_K_M0.0 GB
CH
Chandru1697 gita text generation gpt2 GGUF smashed
Chandru · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB