GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
aixsatoshi/Meta-Llama-3.1-8B-Instruct-plus-Swallow
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 DeluxeTrifecta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Galician
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BA
barc0 100k transduction gpt4omini lr1e 5 epoch2 1 compare stable
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v3 1 only caseus custom
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Uncensored
Llama · ccharnkij
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B bonito v1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
DO
Dolphin X1 8B
Dolphin · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
barc0 google cloude test 20k transduction gpt4omini lr1e 5 epoch2 1
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
KONI Llama3.1 8B Instruct 20241024
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Openmath2
Llama · calcuis
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · SentientAGI
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
ST
stackexchange cstheory
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Natsumura Storytelling Rp 1.0 Llama 3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
ZE
ZEUS 8B V13 i1
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev OH original wo slimorca 550k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8b Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Krikri 8B Instruct
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Llama 3.1 Tulu 3 70B Ko Reasoning
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
dolphin 2.9.4 llama3.1 8b
Llama · NeoChen1024
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BR
Brisk Evolution 12B v0.1
Brisk · mradermacher
Params12B
Context4192K
Q4_K_M7.3 GB
Roleplay
LL
Meta Llama 3.1 405B Instruct 16KV heads
Llama · ThomasBaruzier
Params410B
Context128K
Smallest86.8 GB
GGUF
LL
Llama 3.1 8B Fusion 5050
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 38 rafathenev2.cmrmix.fixedlength shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoning
LL
Meta Llama 3.1 8B Instruct
Llama · martineden
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · starust
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Infinirc 8B Instruct
Llama · RichardErkhov
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct abliterated Q8 0
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
akjindal53244/Llama-3.1-Storm-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing