GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes 3 Llama 3.1 8B
Llama · WSDW
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
shisa v1 llama3 8b.2e5 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70B Instruct ablated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
Llama-3-Giraffe-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
unsloth/llama-3-8b-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Hercules-5.1-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI Llama 3 8B Dolfin v0.6 Abliterated
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MMed Llama 3 8B EnIns
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-ShareGPT-112K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LocalAI Llama3.1 8b Function Call v0.3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
openchat-3.6-8b-20240522
Llama · thesven
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
yentinglin Llama 3 Taiwan 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B WizardLM 196K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LEMMA LLAMA 3 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
BA
BanglaLLM BanglaLLama 3 8b BnWiki Instruct
Banglallm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
aifeifei798/llama3-8B-DarkIdol-2.1-Uncensored-1048K
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
llamagnific 3 87b
Llama · nisten
Params86.8B
Context8K
Smallest24.5 GB
GGUF
LL
Llama 3 8b Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
L3.1 nemotron sunfall v0.7.0
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
HE
L3 Hecate 8B v1.1 i1
Hecate · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KONI Llama3 8B 20240630
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DiscoResearch/Llama3-German-8B-32k
Llama · featherless-ai-quants
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
TA
tabula 8b
Tabula · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Strawberrylemonade L3 70B v1.2 Heretic3
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · MCZK
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
RLHFlow/LLaMA3-iterative-DPO-final
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SU
L3-8B-sunfall-abliterated-v0.1
Sunfall · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 2.9 Llama3 8b 256k
Llama · mradermacher
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF

Keep browsing