GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8B Lexi Uncensored V2 Heretic
Llama · ChiKoi7
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Openbuddy Llama3.1 70b v23.2 131k Sftonly
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
FI
Fino1 8B
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
AstroSage 8B
Astrosage · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Fireplace2
Llama · mudler
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · hearsid
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama3.1 70B ShiningValiant2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nvidia.OpenMath2 Llama3.1 8B
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MIST 1 140B
Mist · mradermacher
Params137B
Context128K
Q4_K_M82.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · qwp4w3hyb
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Fireplace2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev OH original wo gpteacher
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev hp ablations llama3 epoch5
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Flammades 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LW
LwQ 10B Instruct
Lwq · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 3 Korean Bllossom 8B
Llama · joongi007
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · shahzeb171
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 Carballo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · Nekuromento
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Natsumura Storytelling Rp 1.0 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo evol instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo glaive code assistant
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
TheFinAI.Fino1 8B
Fino · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Fusion 6040
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB