GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Mahou-1.3b-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Groq-8B-Tool-Use
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Lexi Llama 3 8B Uncensored
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9.1-llama-3-70b
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
CodingTool use
LL
Llama 3 Youko 8b Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Swallow-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
Daredevil-8B-abliterated-dpomix
Neuraldaredevil · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
StrawberryLemonade L3 70B v1.0
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Hermes 2 Theta Llama 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
alfredplpl Llama 3 8B Instruct Ja
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Groq-70B-Tool-Use
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Llama3 OpenBioLLM 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GE
L3.3 GeneticLemonade Opus 70B
Geneticlemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Discoleo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Magpie-Mix-SFT-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9.1-llama-3-70b
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
LL
Code-Llama-Bagel-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Collaiborator MEDLLM Llama 3 8B v1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Waktaverse Llama 3 KO 8B Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B UltraMedical
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Youko 70b Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HE
Hermes 4 405B
Hermes · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
ST
Strawberrylemonade 70B v1.1
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · failspy
Params8B
Context8K
Smallest4.0 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2-NT
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing