GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
skfrost19 LLaMa 3 Bio domain merged
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ThoxWave 8B
Llama · Thox-ai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Halu-8B-Llama3-v0.35
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
tongliuphysics Llama0 3 8b ultra p 0.075
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
Casual Autopsy Halu L3 Stheno BlackOasis 8B
Casual · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Question To Tagged Question Llama3 Lora
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 2.9 Llama3 8b 256k
Llama · mradermacher
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
LL
OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 70B Instruct Gradient 1048k
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.3 70B Instruct ablated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DI
DiarizationLM 8b Fisher v1
Diarizationlm · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Japanese Llama 3 8b Instruct v2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
abhinand Llama 3 OpenBioMed 8B slerp v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
gsmyrnis llama3 8b baseline instructskillmix
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta llama.Meta Llama Guard 2 8B
Llama · DevQuasar-8
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
cogito v1 preview llama 3B f32
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
AI-Sweden-Models/Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
p208p2002/llama-3-zhtw-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
mzbac/llama-3-8B-Instruct-function-calling
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 8B SingleShotCotV1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
Casual Autopsy Jamet L3 Stheno BlackOasis 8B
Casual · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dread Llama
Llama · juiceb0xc0de
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
lemon07r/Llama-3-MahouDevil-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · Rybens
Params8.03B
Context128K
Smallest3.7 GB
RoleplayTool use
MA
MARS
Mars · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Halu-8B-Llama3-CR-v0.45
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CE
L3 8B Celeste V1.2 i1
Celeste · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Swallow 8B Instruct v0.1 kokoroe
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KoSafeGuard 8b 0503
Llama · heegyu
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing