GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
svd safety l3 swift remove50 swapgapiter b010
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
CyberNative AI Colibri_8b_v0.1
Colibri · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 3 8B Instruct DB Expert
Llama · mradermacher
Params8.03B
Context4K
Q4_K_M4.9 GB
GGUF
NE
NeoBase_8b_v0.2
Neobase · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 typhoon v1.5 8b instruct
Llama · pek111
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DI
Discord Micae Hermes 3 3B
Discord · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3 Ko 8B OpenOrca
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview
Llama · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DA
L3.1 8B Dark Planet Slush
Dark · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
L3.3 GeneticLemonade Unleashed v2 70B
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Daredevil 8B Abliterated
Neuraldaredevil · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
Hermes-4-70B
Hermes · genevaquant
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO-ExPO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
L3-8B-Lunar-Stheno
Lunar · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 6B v0
Llama · mradermacher
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
LL
Llama 3 Youko 70b Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LU
Sao10K/L3-8B-Lunaris-v1
Lunaris · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8b Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 13B Instruct i1
Llama · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
PN
L3 Pneuma 8B
Pneuma · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Magpie Align Llama 3 8B Magpie Align v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B openassistant guanaco llama2 format i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Ultra-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-NeuralMahou-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 70B Chinese Chat
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 8B Web
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 OpenBioLLM 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO-ExPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing