GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 8B ArliAI Formax v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
scb10x llama 3 typhoon v1.5x 70b instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
LLaMA 3 8B SFR Iterative DPO R
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Code Llama Bagel 8B
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
QW
Medgap Qwen 3.5 9b
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
LL
Llama 3 Instruct 8B SimPO
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 Korean Bllossom 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dracarys Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-8B-DarkIdol-1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
DI
DiarizationLM 8b Fisher v2
Diarizationlm · google
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama-3-8B-Magpie-Align-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B ProLong 64k Base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Swallow 70B v0.1
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-8B-OpenHermes-243K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
llama3 42b v0 i1
Llama · mradermacher
Params43.2B
Context8K
Q4_K_M26.1 GB
GGUF
LL
Meta Llama 3 2x8B Instruct MoE 64k ctx
Llama · mradermacher
Params13.7B
Context64K
Q4_K_M8.3 GB
GGUF
LL
Llama3 OpenBioLLM 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · leafspark
Params70.6B
Context128K
Smallest15.3 GB
Tool use
LL
rinna llama 3 youko 8b
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
DeepHermes 3 Llama 3 3B Preview
Llama · NousResearch
Params3.21B
Context128K
Smallest1.9 GB
ReasoningRoleplayTool use
LL
Llama-3-Swallow-8B-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TR
Trendyol LLM 8b Chat v2.0
Trendyol · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
omed llama3 8b i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-Neurona-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
llama-3-70B-Instruct-abliterated
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Badger Iota Llama 3 8b Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing