GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
openchat-3.6-8b-20240522
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v2 8B IT
Llama · aisingapore
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
NousResearch.DeepHermes AscensionMaze RLAIF 8b Atropos
Deephermes · csabakecskemeti
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Discoleo
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Mahou 1.3 llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-70B-Instruct-norefusal
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
LLama3-Lexi-Aura-3Some-SLERP-SLERP
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
L3.3 GeneticLemonade Unleashed v3 70B
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Meta-Llama-3-7B-29Layers
Llama · mradermacher
Params7.38B
Context8K
Q4_K_M4.5 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
scb10x llama 3 typhoon v1.5x 8b instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
HE
L3-Hecate-8B-v1.2
Hecate · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · arcee-ai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 8b merged
Llama · Cutyp
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI Llama 3 8B Cumulus v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 6B v0
Llama · RichardErkhov
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
LL
Llama-3-8B-Instruct_Orce_plus
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 JPRP NSFW 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ReasoningRoleplay
LL
Llama 3 8B Ultra Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b It Prometheus Ko
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OpenCarrot llama3 Mix 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B UltraMedical
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dfurman Llama 3 8B Orpo v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Obsidian
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Taiwan 70B Instruct
Llama · chienweichang
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · OwenArli
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing