GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3 8b Cpt Sealionv2 Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
Luminatium L3 8b
Luminatium · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Yggdrasil-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AE
L3-Aethora-15B
Aethora · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
Llama 3 Ko 8B Instruct AOG
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama-3-Refueled-Pruned
Llama · mradermacher
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
LL
Llama 3 OffsetBias 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-64k
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Karnak 70B LLAMA v1.0 i1
Llama · mradermacher
Params70.8B
Context128K
Q4_K_M42.7 GB
Tool use
NE
Nephra_V1.0
Nephra · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KONI Llama3 8B 20240630
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9.1-llama-3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
LL
LocalAI Llama3 8b Function Call v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JA
L3 Scrambled Eggs On Toast 8B
Jamet · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama3 8B Aifeifei 1.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Galen-70B-v1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
UM
L3-Umbral-Mind-RP-v0.6.2-8B
Umbral · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3 70B Instruct Gradient 1048k i1
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
GGUF
LL
llama3 8B DarkIdol 2.1 Uncensored 32K
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
llama3 diverce ver1.6 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EU
L3.3 70B Euryale v2.3
Euryale · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
thagiPo-llama3.2-1B-math
Llama · tinyopsec
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
Llama 3 Taiwan 8B Instruct 128k
Llama · chienweichang
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Groq 8B Tool Use
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Tool use
LL
jkazdan llama8b gsm real sftsd1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PO
pogny
Pogny · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
RetrospexLLaMA3
Retrospexllama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Youko 70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-11b-Instruct
Llama · mradermacher
Params11.1B
Context8K
Q4_K_M6.7 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing