GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Python wizard Llama 3.1 8b
Llama · ShyamSaran-18
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
New Llama 3.1 8B Lexi Uncensored V2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CL
L3.1 Clouded Uchtave v0.1 8B i1
Clouded · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
TitanForge 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
KoBioMed Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1 2 only evol instruct
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B LatamGPT SFT 1.0
Llama · jairo
Params70.6B
Context4K
Q4_K_M42.5 GB
GGUF
LL
Orenguteng Llama 3.1 8B Lexi Uncensored V2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SU
Sundry 1
Sundry · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev OH original wo evol instruct 140k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 Tulu 3 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo collective cognition
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TU
Tulu Tree Fiddy 8B i1
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
ML
mlfoundations dev oh v1.3 unnatural instructions x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K M
Llama · Memphi
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AS
AstroSage 8B
Astrosage · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3.1-8B-Instruct
Llama · byteshape
Params8.03B
Context128K
Smallest2.6 GB
Tool use
LL
Llama 3.1 8B Instruct Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Stheno v3.4
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.3
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Lugha Llama 8B Wura
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 unnatural instructions x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated ICONN 1 BasicChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
DS Distilled Hermes Llama 3.1 TIES i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AS
Assistant_Pepe_8B
Assistant · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
GGUF
LL
Llamaverse 3.1 8B Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1 2 only unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing