GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ChatQA-1.5-8B
Llama · lmstudio-community
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
New-Dawn-Llama-3-70B-32K-v1.0
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
LL
cstr/llama3-8b-spaetzle-v20
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
Soren Oracle Chat 3B
Soren · Jackrong
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Defne llama3 2x8B i1
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
LL
Awanllm-Llama-3-8B-Dolfin-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Cobalt
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
failspy/Llama-3-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMAntino 3 ANITA 8B Inst DPO ITA
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Romulus cpt Llama 3.1 8B v0.1 Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SU
L3-70B-sunfall-abliterated-v0.1
Sunfall · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SL
L3.1 8B Slush v1.1
Slush · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Hermes 3 Llama 3.1 70B
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
llama 3 8B function calling
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
OP
openchat 3.6 8b 20240522 i1
Openchat · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
simonycl llama 3 8b instruct metamath agg judge
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9 llama3 8b 256k
Llama · QuantFactory
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
LL
Llama3 OpenBioLLM 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
UN
L3-Uncen-Merger-Omelette-RP-v0.1.1-8B
Uncen · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3 WhiteRabbitNeo 8B v2.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b It Translation General En Ko 1sent
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 8B OpenMath FT
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
DeepHermes 3 Llama 3 8B Preview
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningRoleplayTool use
LL
Llama 3 Youko 8b Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SU
L3.1 8B sunfall v0.6.1 dpo i1
Sunfall · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Pro SFT 100K v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SU
L3 Super Nova RP 8B
Super · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
LEMMA LLAMA 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing