GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Codellama 3 8B Finetuned Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Japanese Llama 3 8b Instruct v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.1 Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Roleplay
LL
Finance Llama3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Tess 2.0 Llama 3 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 70B UltraMedical
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 ELYZA JP 8B
Llama · tatsuyaaaaaaa
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
KoSafeGuard 8b 0503 i1
Kosafeguard · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 2 Theta Llama 3 70B
Llama · DevQuasar-10
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Vanila
Llama · nanakura
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
Magpie Align Llama 3 8B Magpie Pro SFT 300K v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 6B v0
Llama · mradermacher
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
LL
Llama 3 Heron Brain 70B v0.3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
LLaMA 3 8B SFR SFT R
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
anakin87 Llama 3 8b ita ties pro
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 70B Orion Chinese
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
NousResearch/Hermes-3-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 8B Stroganoff 2.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA 3 8B SFR Iterative DPO R
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct Jailbroken
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-LiPPA-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct OS Expert
Llama · mradermacher
Params8.03B
Context4K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · ClaudioItaly
Params8.03B
Context128K
Smallest5.7 GB
RoleplayTool use
LL
Llama-3-Yggdrasil-8B
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
JA
Jamet-8B-L3-MK.V-Blackroot
Jamet · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-70B-Instruct-abliterated
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
AI Sweden Models Llama 3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing