GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Llama Estllm Prototype 0825
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
BA
barc0 transduction rearc fft 35k
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
openthoughts3 3k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 405B Q4 K M
Llama · francklit
Params406B
Context128K
Q4_K_M243.1 GB
GGUF
LL
dragon llama 3.1
Llama · llmware
Params8.03B
Context128K
Smallest4.9 GB
GGUF
ET
L3.1-EtherealRainbow-v1.0-rc1-8B
Etherealrainbow · invisietch
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Chainbase Labs Theia Llama 3.1 8B v1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 Amelia AR 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · rumbleFTW
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · aifeifei798
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Selene 1 Mini Llama 3.1 8B IQ3 XS
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.5 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · AL-DN
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · zak66
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest4.0 GB
GGUF
WA
WangchanLION v3 IT
Wangchanlion · Thiraput01
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · irresistiblegrace97
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Trisert
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Morgen0052
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama Guard 3 8B
Llama · lauraharyo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo camel ai math
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · Ffftdtd5dtft
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · fanshanga
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
Devple 8B
Devple · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 claude 8b
Llama · crystalai35
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
NU
NutukLLM V1
Nutukllm · Gokalp35
Params8.03B
Context128K
Smallest4.9 GB
GGUF
LL
Ablation 164 Shisav2.If100 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay

Keep browsing