GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · NousResearch
Params8B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
models--fireworks-ai--firefunction-v2
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
vntl llama3 8b v2
Llama · lmg-anon
Params8B
Context8K
Smallest5.7 GB
GGUF
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
Hermes 3 Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Meta llama_Meta Llama 3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
EU
L3.3 70B Euryale v2.3
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Lexi-Llama-3-8B-Uncensored
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HE
Hermes-4-70B
Hermes · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · NousResearch
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
Meta-Llama-3-8B-Instruct-imatrix
Llama · lmstudio-community
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · modularai
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-ELYZA-JP-8B
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
UM
BojroPromptMaster uncensored v2 8B
Umbral · bojrodev
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
llama3.1 airoboros3.2 QDT 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Groq-8B-Tool-Use
Llama · lmstudio-community
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
HE
Hermes 4 70B
Hermes · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
LL
Llama 3.3 70B Instruct ablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
NousResearch DeepHermes 3 Llama 3 8B Preview
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Llama3-ChatQA-1.5-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
LL
Hermes 3 Llama 3.1 405B
Llama · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
RoleplayTool use
LL
Llama3Ternary 10b
Llama · CMSManhattan
Params9.64B
Context8K
Smallest4.3 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
RoleplayTool use

About the llama3 license

Llama 3 models use Meta’s custom community license, which has its own conditions, including limits for very large services. Read it before commercial use.

3,439 GGUF models are listed under llama3 on Hugging Face. The most downloaded are Meta-Llama-3-70B-Instruct-abliterated-v3.5, Meta Llama 3 8B Instruct and Hermes 3 Llama 3.1 8B. This is information, not legal advice: always read the license in the repository before you use a model commercially.

Frequently asked questions

Can I use llama3 GGUF models commercially?

Llama 3 models use Meta’s custom community license, which has its own conditions, including limits for very large services. Read it before commercial use. Check the license text in the repository and the license of the base model before you build a product on it.

Keep browsing