GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
StrawberryLemonade-L3-70B-v1.0
Strawberrylemonade · ddh0
Params70.6B
Context128K
Smallest40.4 GB
ReasoningTool use
LL
Halu-8B-Llama3-v0.3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B
Llama · polyverse
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
tongliuphysics Llama0 3 8b v0.1 p 0.05 lr6e 7 e1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 SthenoMaid 8B V1
Sthenomaid · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · LoneStriker
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
SU
L3 Super Nova RP 8B
Super · s6135
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
tongliuphysics Llama 3 8b ultra dpo e2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
theo77186/Llama-3-70B-Instruct-norefusal
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · SYNERDATA
Params8.03B
Context128K
Smallest8.5 GB
RoleplayTool use
LL
ArliAI-Llama-3-8B-Instruct-DPO-v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Nvidia Llama3 ChatQA 1.5 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
LL
Meta Llama 3 8B
Llama · shahzeb171
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
KISTI KONI KONI Llama3 8B 20240630
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
CodingTool use
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest3.8 GB
GGUF
ET
EtherealRainbow-v0.2-8B
Etherealrainbow · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3SOME 8B V2D
Llama · l3utterfly
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-CHT-Q4
Llama · suko
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · Ffftdtd5dtft
Params8.03B
Context128K
Smallest2.0 GB
RoleplayTool use
SU
L3-8B-sunfall-v0.1
Sunfall · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
simonycl llama 3.1 8b instruct armorm judge iter3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Spark
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Collaiborator MEDLLM Llama 3 8B v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Anjay-8B-Llama3-CrestRoot
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Med-ChimeraLlama-3-8B_SHERP
Med · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · HeRksTAn
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
penny5-dolphin-einstein-llama3-dare-ties-chatml
Llama · giannisan
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing