GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
aixsatoshi/Meta-Llama-3.1-8B-Instruct-plus-Swallow
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 DeluxeTrifecta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Galician
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
barc0 100k transduction gpt4omini lr1e 5 epoch2 1 compare stable
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only caseus custom
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Uncensored
Llama · ccharnkij
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B bonito v1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
DO
Dolphin X1 8B
Dolphin · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
barc0 google cloude test 20k transduction gpt4omini lr1e 5 epoch2 1
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KONI Llama3.1 8B Instruct 20241024
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Openmath2
Llama · calcuis
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · SentientAGI
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange cstheory
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Natsumura Storytelling Rp 1.0 Llama 3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V13 i1
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo slimorca 550k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Krikri 8B Instruct
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Llama 3.1 Tulu 3 70B Ko Reasoning
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · NeoChen1024
Params8.03B
Context128K
Q4_K_M4.9 GB
BR
Brisk Evolution 12B v0.1
Brisk · mradermacher
Params12B
Context4192K
Q4_K_M7.3 GB
LL
Meta Llama 3.1 405B Instruct 16KV heads
Llama · ThomasBaruzier
Params410B
Context128K
Smallest86.8 GB
LL
Llama 3.1 8B Fusion 5050
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 38 rafathenev2.cmrmix.fixedlength shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · martineden
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · starust
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Infinirc 8B Instruct
Llama · RichardErkhov
Params8.03B
Context64K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct abliterated Q8 0
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
akjindal53244/Llama-3.1-Storm-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB