GGUF models by PrunaAI

95 GGUF models quantized by PrunaAI on Hugging Face. Sizes run from 10M to 141B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ajibawa 2023 Code Llama 3 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
huggyllama llama 7b GGUF smashed
Llama · PrunaAI
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
dolphin 2.9 llama3 8b 1m GGUF smashed
Llama · PrunaAI
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
FI
T5 Small
Finetune · PrunaAI
Params61M
Context512
Q4_K_M0.0 GB
GGUF
CH
Chandru1697 gita text generation gpt2 GGUF smashed
Chandru · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing