GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
CabraLlama3 70b
Cabrallama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OR
orca mini v5 8b
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
L3 8B Lunaris v1 Q4 K M
Lunaris · beebsluvr
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Nephra_V1.0
Nephra · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BU
budllama3 8b
Budllama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 OpenBioLLM 8B
Llama · Mardiyyah
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Halu-8B-Llama3-v0.35
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Stroganoff 2.0
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
cere llama 3 8b tr
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
lemon07r llama 3 NeuralMahou 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8b ita slerp
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama-3-Groq-8B-Tool-Use
Llama · rumbleFTW
Params8.03B
Context8K
Smallest8.5 GB
Tool use
LL
Llama 3 Groq 8B Tool Use Q3 K L
Llama · NicolasNoya
Params8.03B
Context8K
Smallest4.3 GB
Tool use
LL
scb10x/llama-3-typhoon-v1.5x-70b-instruct
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
UL
UltimateANJIR-8B-L3-Blackroot
Ultimateanjir · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
calme-2.3-llama3-70b
Llama · RichardErkhov
Params70.6B
Context8K
Smallest26.4 GB
GGUF
NY
L3 Nymeria v2 8B
Nymeria · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
bellman
Llama · neph1
Params8.03B
Context8K
Smallest6.6 GB
GGUF
LL
Llama-3-Groq-8B-Tool-Use
Llama · nwilkie
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
abacusai/Smaug-Llama-3-70B-Instruct-32K
Llama · featherless-ai-quants
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
LL
NousResearch/Hermes-2-Theta-Llama-3-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
abacusai/Smaug-Llama-3-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
tongliuphysics Llama0 3 8b ultra p 0.025
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
SFR-Iterative-DPO-LLaMA-3-8B-R
Llama · cminja
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama-3-8B-saiga-suzume-ties
Llama · RachidAR
Params8.03B
Context8K
Smallest6.6 GB
GGUF
LL
Llama 3 OpenBioMed 8B slerp v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · ChipsAKALudo
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 8b rag grounded
Llama · chaitanya-rathi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 natsuki ddlc 8b v1
Llama · 922-CA
Params8.03B
Context8K
Smallest4.9 GB
GGUF

Keep browsing