GGUF models by PrunaAI
95 GGUF models quantized by PrunaAI on Hugging Face. Sizes run from 10M to 141B parameters. The longest trained context is 1024K tokens.
LL
Llama 3 8B Instruct 262k GGUF smashed
Llama · PrunaAI
Params8.03B
Context256K
Q4_K_M4.9 GB
GE
gemma 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
EM
EMO 1.5B GGUF smashed
Emo · PrunaAI
Params1.84B
Context4K
Q4_K_M1.2 GB
LL
RuterNorway Llama 2 13b chat norwegian GGUF smashed
Llama · PrunaAI
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama3 8B Chinese Chat GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
TU
turkish gpt2 large GGUF smashed
Turkish · PrunaAI
Params838M
Context1K
Q4_K_M0.5 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · PrunaAI
Params10M
Context128K
Q4_K_M0.0 GB
DE
deepseek ai DeepSeek R1 Distill Llama 8B GGUF smashed
DeepSeek · PrunaAI
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B 16K GGUF smashed
Llama · PrunaAI
Params8.03B
Context16K
Q4_K_M4.9 GB
DE
LoneStriker DeepSeek R1 Distill Llama 70B 8.0bpw h8 exl2 GGUF smashed
DeepSeek · PrunaAI
Params13M
Context128K
Q4_K_M0.0 GB
LL
Llama 3 8B Web GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
cognitivecomputations Llama 3 8B Instruct abliterated v2 GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
ajinkya ftpl gemma loan develop 28jan GGUF smashed
Gemma · PrunaAI
Params9.24B
Context8K
Q4_K_M5.8 GB
CO
codegemma 7b GGUF smashed
Codegemma · PrunaAI
Params8.54B
Context8K
Q4_K_M5.3 GB
GI
amireddy gita text generation gpt2 GGUF smashed
Gita · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
NE
Nexusflow NexusRaven V2 13B GGUF smashed
Nexusflow · PrunaAI
Params13B
Context16K
Q4_K_M7.9 GB
SP
speakleash Bielik 7B v0.1 GGUF smashed
Speakleash · PrunaAI
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
nirusanan Qwen2.5 1.5B NextJs code GGUF smashed
Qwen · PrunaAI
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
cognitivecomputations dolphin 2.9.2 qwen2 72b GGUF smashed
Qwen · PrunaAI
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
NousResearch Hermes 2 Pro Llama 3 70B GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
YT
ytu ce cosmos turkish gpt2 GGUF smashed
Ytu · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
ME
maheshhuggingface Medical Data Question Answers finetuned gpt2 GGUF smashed
Medical · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
LL
Llama 3 Lumimaid 8B v0.1 GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
GreatCaptainNemo ProLLaMA GGUF smashed
Greatcaptainnemo · PrunaAI
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Undi95 Llama 3 LewdPlay 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
starcoder2 7b GGUF smashed
StarCoder · PrunaAI
Params7.17B
Context16K
Q4_K_M4.5 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · PrunaAI
Params10M
Context986K
Q4_K_M0.0 GB
PH
cognitivecomputations Dolphin 2.9.1 Phi 3 Kensho 4.5B GGUF smashed
Phi · PrunaAI
Params6.54B
Context4K
Q4_K_M4.0 GB
UN
UnfilteredAI UNfilteredAI 1B GGUF smashed
Unfilteredai · PrunaAI
Params1.06B
Context2K
Q4_K_M0.6 GB
GI
chandankumar07 gita text generation gpt2 GGUF smashed
Gita · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB