GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
MFANN llama3.1 abliterated SLERP v3.1 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 Instruct Abliterated Nephilim_v3_via_adapter 8B
Llama · pegasus912
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Llama 3.1 8B Instruct Ortho
Llama · DCBIA-OrthoLab
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · nautilie7
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · GrimsenClory
Params8.03B
Context128K
Smallest4.4 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
WellMinded Therapy Engine
Llama · PixelPanda1
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · joshnader
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Magpie Align Llama 3.1 8B Magpie Align v0.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · Laocaicai
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
mlfoundations dev openthoughts3 10k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
SO
Soulbound 8B
Soulbound · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama PLLuM 70B Base 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Ft Agentworld 8b
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · LouiSeHU
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llama AuditLM
Llama · vimalnakrani
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · fernandoruiz
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Pranav102999
Params8.03B
Context128K
Smallest4.0 GB
GGUF
LL
Llama Guard 3 8B
Llama · Fabio2000
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.24 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct.Q4 0 4 8
Llama · gbueno86
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K M
Llama · roleplaiapp
Params70.6B
Context128K
Smallest49.9 GB
CodingRoleplayTool use
LL
Llama 3.1 Tulu 3.1 8B Q4 K M
Llama · Cran-May
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · dpant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 KoEn 8b Coder DARE
Llama · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Ft Counsel Meta Llama 3.1 8B Instruct Jepa Loraembed
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
Embedding
LL
Selene 1 Mini Llama 3.1 8B Q5 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
SaphraFgt 1.0 8B
Llama · Stephen16
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Pllum 70b Instruct 2512
Llama · marcinm1234
Params70.6B
Context128K
Smallest75.0 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · Ffftdtd5dtft
Params8.03B
Context128K
Smallest3.2 GB
GGUF

Keep browsing