GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
L3-Hecate-8B-v1.0
Hecate · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-UltraDPO3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes-2-Theta-Llama-3-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Meta-Llama-3-7B-28Layers
Llama · mradermacher
Params7.16B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Llama3 8b Cpt Sea Lionv2 Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9 llama3 8b
Llama · cstr
Params8.03B
Context8K
Smallest4.9 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
llama3 turbcat instruct 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Taiwan 8B Instruct Rc2
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Mahou-1.2-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Experiment v1 9B
Llama · mradermacher
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
LL
Llama-3-Perky-Pat-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI Llama 3 8B Dolfin v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Swallow-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
shisa-v1-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 OpenBioMed 8B slerp v0.3 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 70B Instruct Abliterated v3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
LLaMa3-8b-WangchanX-sft-Full
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
m2hai unsensored 8b
Llama · m2hgamerz
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama3-Swallow-8B-instruct-vector-merged
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepHermes Egregore v1 RLAIF 8b Atropos
Deephermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama Spark
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
L3.3 GeneticLemonade Unleashed v2.1 70B
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3 70B ShiningValiant2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Hercules-5.0-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Lexi Smaug Uncensored
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Mahou-1.3b-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing