GGUF models by PrunaAI

95 GGUF models quantized by PrunaAI on Hugging Face. Sizes run from 10M to 141B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 8B Instruct 262k GGUF smashed
Llama · PrunaAI
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
GE
gemma 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
EM
EMO 1.5B GGUF smashed
Emo · PrunaAI
Params1.84B
Context4K
Q4_K_M1.2 GB
GGUF
LL
RuterNorway Llama 2 13b chat norwegian GGUF smashed
Llama · PrunaAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama3 8B Chinese Chat GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TU
turkish gpt2 large GGUF smashed
Turkish · PrunaAI
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · PrunaAI
Params10M
Context128K
Q4_K_M0.0 GB
ReasoningTool use
DE
deepseek ai DeepSeek R1 Distill Llama 8B GGUF smashed
DeepSeek · PrunaAI
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3 8B 16K GGUF smashed
Llama · PrunaAI
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
DE
LoneStriker DeepSeek R1 Distill Llama 70B 8.0bpw h8 exl2 GGUF smashed
DeepSeek · PrunaAI
Params13M
Context128K
Q4_K_M0.0 GB
ReasoningTool use
LL
Llama 3 8B Web GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
cognitivecomputations Llama 3 8B Instruct abliterated v2 GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
ajinkya ftpl gemma loan develop 28jan GGUF smashed
Gemma · PrunaAI
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CO
codegemma 7b GGUF smashed
Codegemma · PrunaAI
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GI
amireddy gita text generation gpt2 GGUF smashed
Gita · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
NE
Nexusflow NexusRaven V2 13B GGUF smashed
Nexusflow · PrunaAI
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
SP
speakleash Bielik 7B v0.1 GGUF smashed
Speakleash · PrunaAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
nirusanan Qwen2.5 1.5B NextJs code GGUF smashed
Qwen · PrunaAI
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
QW
cognitivecomputations dolphin 2.9.2 qwen2 72b GGUF smashed
Qwen · PrunaAI
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
LL
NousResearch Hermes 2 Pro Llama 3 70B GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
YT
ytu ce cosmos turkish gpt2 GGUF smashed
Ytu · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
maheshhuggingface Medical Data Question Answers finetuned gpt2 GGUF smashed
Medical · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Llama 3 Lumimaid 8B v0.1 GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
GreatCaptainNemo ProLLaMA GGUF smashed
Greatcaptainnemo · PrunaAI
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Undi95 Llama 3 LewdPlay 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
starcoder2 7b GGUF smashed
StarCoder · PrunaAI
Params7.17B
Context16K
Q4_K_M4.5 GB
Coding
QW
Qwen2.5 7B Instruct 1M
Qwen · PrunaAI
Params10M
Context986K
Q4_K_M0.0 GB
Tool use
PH
cognitivecomputations Dolphin 2.9.1 Phi 3 Kensho 4.5B GGUF smashed
Phi · PrunaAI
Params6.54B
Context4K
Q4_K_M4.0 GB
GGUF
UN
UnfilteredAI UNfilteredAI 1B GGUF smashed
Unfilteredai · PrunaAI
Params1.06B
Context2K
Q4_K_M0.6 GB
GGUF
GI
chandankumar07 gita text generation gpt2 GGUF smashed
Gita · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing