GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
MFANN llama3.1 abliterated SLERP v3.1 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 Instruct Abliterated Nephilim_v3_via_adapter 8B
Llama · pegasus912
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama 3.1 8B Instruct Ortho
Llama · DCBIA-OrthoLab
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · nautilie7
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · GrimsenClory
Params8.03B
Context128K
Smallest4.4 GB
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
WellMinded Therapy Engine
Llama · PixelPanda1
Params8.03B
Context128K
Smallest4.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · joshnader
Params8.03B
Context128K
Smallest8.5 GB
LL
Magpie Align Llama 3.1 8B Magpie Align v0.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama3.1 8B Chinese Chat
Llama · Laocaicai
Params8.03B
Context128K
Smallest6.6 GB
LL
mlfoundations dev openthoughts3 10k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SO
Soulbound 8B
Soulbound · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Base 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Ft Agentworld 8b
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · LouiSeHU
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama AuditLM
Llama · vimalnakrani
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · fernandoruiz
Params8.03B
Context128K
Smallest4.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Pranav102999
Params8.03B
Context128K
Smallest4.0 GB
LL
Llama Guard 3 8B
Llama · Fabio2000
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.24 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct.Q4 0 4 8
Llama · gbueno86
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K M
Llama · roleplaiapp
Params70.6B
Context128K
Smallest49.9 GB
LL
Llama 3.1 Tulu 3.1 8B Q4 K M
Llama · Cran-May
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · dpant
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KoEn 8b Coder DARE
Llama · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ft Counsel Meta Llama 3.1 8B Instruct Jepa Loraembed
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Selene 1 Mini Llama 3.1 8B Q5 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
LL
SaphraFgt 1.0 8B
Llama · Stephen16
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Pllum 70b Instruct 2512
Llama · marcinm1234
Params70.6B
Context128K
Smallest75.0 GB
LL
Meta Llama 3.1 8B
Llama · Ffftdtd5dtft
Params8.03B
Context128K
Smallest3.2 GB