GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 Smolphin 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Synthia v3.5
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SU
crestf411/L3.1-8B-sunfall-v0.6.1-dpo
Sunfall · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SU
L3-70B-sunfall-abliterated-v0.2
Sunfall · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Taiwan 70B Instruct DPO
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-imatrix
Llama · DonnieRules5312
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
fearlessdots/Llama-3-Alpha-Centauri-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Synthia-v3.5
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Shenzhi Wang Llama3 8B Chinese Chat
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OR
orca mini v6 8b
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
klcsp llama3.1 8b gpt4o 100k classification fft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
Orca_Mini_V5_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 cat 8b instruct v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · ngxson
Params88M
Context—
Smallest0.4 GB
GGUF
CA
Casual Autopsy L3 Umbral Mind RP v0.3 8B
Casual · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
llama 3 instruct slerp arabic
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Chatbench Llama3 8b
Llama · ysn-rfd
Params7M
Context8K
Smallest0.0 GB
GGUF
LL
cstr llama3 8b spaetzle v37
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Kuno K1 Llama 3.2 3b
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Roleplay
SU
L3.1 8B sunfall v0.6.1 dpo
Sunfall · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA 3 8B Instruct Abliterated TR Q4 K M
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B OpenFlow
Llama · Atomic-Germ
Params8.03B
Context128K
Smallest5.0 GB
Tool use
LL
AXCXEPT Llama 3 EZO 8b Common it
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Failspy Llama 3 70B Instruct Abliterated v3
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
LL
Hermes 2 Pro Llama 3 8b DPO
Llama · SandLogicTechnologies
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Giraffe 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-3x8B-multilingual
Llama · mradermacher
Params19.3B
Context80K
Q4_K_M11.7 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing