GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
ML
mlfoundations dev oh v1 2 only camel biology
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ambuj Tripathi Llama 3.1 8B IndianLegal
Llama · invincibleambuj
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
llama3.1 typhoon2 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
openthoughts3 100k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Dolerstormed V1.04 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IN
L3.1 8b RP Ink
Ink · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Evilguy_Gguf
Llama · anyalkonsafe
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dirty Alice RP NSFW llama 4B
Llama · D1rtyB1rd
Params4.51B
Context128K
Q4_K_M2.8 GB
Roleplay
LL
Llama SEA LION v3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
huihui-ai/Meta-Llama-3.1-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Stormeder v1.04 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EI
L3.1 EinsteinCobaltBioCoder 8B ModelStock
Einsteincobaltbiocoder · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
IN
allura org.L3.1 8b RP Ink
Ink · DevQuasar-9
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
DongfuJiang prm version3 subsample no ref hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo metamath 40k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo unreplicated
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hercules 6.0 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 Asian Bllossom 8B Translator
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Medusa v1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mattshumer Reflection Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3_1 8B Instruct AMD Python
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev evol tt 1s
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlabonne Llama 3.1 70B Instruct lorablated
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
EIRTHAIMED/Llama-3.1-EIRAI-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Natsumura Llama3.1 v1.0 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing