GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Python wizard Llama 3.1 8b
Llama · ShyamSaran-18
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
New Llama 3.1 8B Lexi Uncensored V2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CL
L3.1 Clouded Uchtave v0.1 8B i1
Clouded · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
TitanForge 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KoBioMed Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 2 only evol instruct
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B LatamGPT SFT 1.0
Llama · jairo
Params70.6B
Context4K
Q4_K_M42.5 GB
LL
Orenguteng Llama 3.1 8B Lexi Uncensored V2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SU
Sundry 1
Sundry · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev OH original wo evol instruct 140k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo collective cognition
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
Tulu Tree Fiddy 8B i1
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 unnatural instructions x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K M
Llama · Memphi
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
AstroSage 8B
Astrosage · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3.1-8B-Instruct
Llama · byteshape
Params8.03B
Context128K
Smallest2.6 GB
LL
Llama 3.1 8B Instruct Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.3
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Lugha Llama 8B Wura
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 unnatural instructions x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated ICONN 1 BasicChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DS Distilled Hermes Llama 3.1 TIES i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Assistant_Pepe_8B
Assistant · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
LL
Llamaverse 3.1 8B Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 2 only unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB