GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AU
aum 1 70B i1
Aum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Lllama-3-RedElixir-8B
Lllama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ReBatch Llama 3 8B dutch
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
klcsp llama3 8b fft summarization 11 v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nbeerbower llama3.1 gutenberg 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LocalAI Llama3.1 8b Function Call v0.3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
failspy Llama 3 8B Instruct abliterated
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-turbcat-instruct-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AS
L3-MS-Astoria-70b
Astoria · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Rinna.Llama 3 Youko 8b Instruct
Llama · DevQuasar-10
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
NousResearch.Hermes 4 70B
Hermes · DevQuasar
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
AE
L3-NA-Aethora-15B
Aethora · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
DeepHermes-3-Llama-3-8B-Preview
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
ReasoningRoleplayTool use
LL
Ko Llama 3.1 5b Instruct
Llama · joongi007
Params5.85B
Context128K
Q4_K_M3.6 GB
Tool use
LL
llama 3 Daredevil Mahou 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 70B Instruct ablated
Llama · Justbackup
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
CH
ChenWeiLi MedLlama 3 8B DARE
Chenweili · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Huihui ai.DeepHermes 3 Llama 3 8B Preview Abliterated
Llama · DevQuasar-8
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Raj Maharajwala Open Insurance LLM Llama3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b It Prometheus Ko
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
CataLlama v0.1 Base
Catallama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AF
Affectra 2 8B EQ
Affectra · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
LL
llama-3-sauce-v2-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LA
Lama3.1 8B EksiSozlukAI
Lama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
L3-70B-daybreak-abliterated-v0.4
Daybreak · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
RoleplayTool use
LL
simonycl llama 3.1 8b instruct armorm judge iter2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
calme-2.3-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
ET
EtherealRainbow v0.3 8B
Etherealrainbow · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing