GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
gbt4o
Llama · yunkitten
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Bllossom70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · lowlevelgoblin
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama3 DiscoLeo Instruct 8B 32k v0.1
Llama · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
LL
nayohan/llama3-instrucTrans-enko-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Aisingapore Llama3 8b Cpt Sea Lionv2 Base
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Vocalis Q4 K M
Llama · lex-au
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3 8B Instruct
Llama · SandLogicTechnologies
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CE
cerberus-v0.1
Cerberus · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SV
Jeesup svd safety l3 swift jbbsft10 remove30
Svd · tinyopsec
Params8.03B
Context8K
Smallest16.1 GB
GGUF
LL
WeMake/Llama-3-8B-Instruct-V41-1048k
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Distilled
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Heron Brain 70B v0.3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
TR
Trendyol LLM 8b Chat v2.0
Trendyol · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Tulu-330K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
anakin87/Llama-3-8b-ita-slerp
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JA
Jamet-L3-Stheno-BlackOasis-8B
Jamet · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
failspy/llama-3-70B-Instruct-abliterated
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DE
BotCuddles/to_deploy
Deploy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
anakin87/Llama-3-8b-ita-ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
seedboxai/Llama-3-KafkaLM-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hastagaras Halu 8B Llama3 Blackroot
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
lighteternal/Llama3-merge-biomed-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · LoneStriker
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Jimmy19991222 llama 3 8b instruct gapo v2 rougeL beta2 he scale gamma0.3 lr2.0e 6
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UM
L3-Umbral-Mind-RP-v3-8B
Umbral · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
EX
Executer Virus 3.2 1B
Executer · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Roleplay
LL
llama 3 Korean Bllossom 70B gguf Q4 K M
Llama · Bllossom
Params70.8B
Context8K
Q4_K_M42.7 GB
GGUF

Keep browsing