GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Lexi Uncensored V2 Heretic
Llama · ChiKoi7
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Openbuddy Llama3.1 70b v23.2 131k Sftonly
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
FI
Fino1 8B
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
AS
AstroSage 8B
Astrosage · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Fireplace2
Llama · mudler
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · hearsid
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 70B ShiningValiant2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
nvidia.OpenMath2 Llama3.1 8B
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
MIST 1 140B
Mist · mradermacher
Params137B
Context128K
Q4_K_M82.4 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · qwp4w3hyb
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Fireplace2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ML
mlfoundations dev OH original wo gpteacher
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev hp ablations llama3 epoch5
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Flammades 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LW
LwQ 10B Instruct
Lwq · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3 Korean Bllossom 8B
Llama · joongi007
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · shahzeb171
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 Carballo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · Nekuromento
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Natsumura Storytelling Rp 1.0 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo evol instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo glaive code assistant
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
FI
TheFinAI.Fino1 8B
Fino · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Fusion 6040
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing