GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mixllama3 8x8b Instruct v0.1
Mixllama · mradermacher
Params47.5B
Context8K
Q4_K_M29.0 GB
GGUF
DA
L3.1 8B Dark Planet Slush
Dark · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
L3.3 GeneticLemonade Unleashed v2 70B
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Egyptian Arabic Translator Llama 3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama3 ViettelSolutions 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
CAI Supernova r1
Cai · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
SU
L3.1 8B sunfall v0.6 dpo i1
Sunfall · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Swallow-8B-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TA
tabula 8b
Tabula · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
TsinghuaC3I/Llama-3-8B-UltraMedical
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Groq Llama 3 Groq 70B Tool Use
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
ArliAI Llama 3 8B Dolfin v0.6 Abliterated
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LE
LexiFreak 8B Unleashed
Lexifreak · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Groq Llama 3 Groq 8B Tool Use
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 OpenBioMed 8B slerp v0.3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-Salad-4x8B-V3
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
ST
Strawberrylemonade L3 70B v1.2 Heretic2
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3-Instruct-abliteration-OVA-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Swallow 8B Instruct v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Samantha roleplay ptbr v2
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
LL
llama3.1 airoboros3.2 QDT 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
TARS-8B-llama-REMIX-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
owner203/japanese-llama-3-8b-instruct-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Trendyol LLM 8b Chat v2.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Halu-8B-Llama3-Blackroot
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v2 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Jimmy19991222 llama 3 8b instruct gapo v2 rouge2 beta10 1minus gamma0.3 rerun
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UM
L3-Umbral-Mind-RP-v2.0-8B
Umbral · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
ArliAI Llama 3 8B Instruct ORPO v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing