GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 ChocoLlama 8B Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-neoAI-8B-Chat-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · rubra-ai
Params8.9B
Context8K
Q4_K_M5.4 GB
Tool use
MA
Maenad 70B
Maenad · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Meta-Llama-3-8B-Instruct
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.0 GB
GGUF
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
RE
RE 70B AS3D i1
mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
TA
tabula-8b
Tabula · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct DB Expert
Llama · csabakecskemeti
Params8.03B
Context4K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · EWen12
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Turkish Llama 8b Instruct v0.1
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-DPO-v0.3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Magpie Align Llama 3 8B Magpie Align v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3-ChatQA-1.5-70B
Llama · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama Spark
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DI
Discord Micae Hermes 3 8B
Discord · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-8B-Instruct-262k
Llama · bartowski
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
rubra ai Meta Llama 3 8B Instruct
Llama · RichardErkhov
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
LL
Hermes-2-Theta-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 8B Abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · osanseviero
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama Guard 2 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
FactAlign LLaMA 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LocalAI Llama3 8b Function Call v0.2 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Giraffe-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Perky-Pat-Instruct-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct 262k
Llama · mradermacher
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
ArliAI Llama 3 8B Argon v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing