GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-Physician-8B-Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
L3 Theta Cat 2x8B Bf16
Theta · gelukuMLG
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
LL
anakin87 Llama 3 8b ita ties
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AU
Aura 8B SFT i1
Aura · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Emotional llama 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-LLama-3-Cat-A-LLama-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DE
Al_Dente_v1_8b
Dente · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Youko 8b En Ja MT LoRA
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VA
Value4AI ValueLlama 3 8B
Value · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 70B Fireplace
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
L3 Deluxe Scrambled Eggs On Toast 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingRoleplayTool use
LL
Llama 3 70B Instruct Gradient 524k i1
Llama · mradermacher
Params70.6B
Context512K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Mix RC UltraDPO 08 3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DI
DiarizationLM 8b Fisher v1
Diarizationlm · google
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
BCCard Llama 3 Kor BCCard Finance 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Finance Llama3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
New-Dawn-Llama-3-70B-32K-v1.0
Llama · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
LL
SinLlama Llama 3 8B Merged
Llama · mradermacher
Params8.12B
Context8K
Q4_K_M5.0 GB
GGUF
LL
NousResearch.DeepHermes 3 Llama 3 8B Preview
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SO
Soren Logos 3B
Soren · Jackrong
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
UM
L3-Umbral-Mind-RP-v1.0.1-8B
Umbral · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
Roleplay
LL
Meta llama.Meta Llama 3 70B Instruct
Llama · DevQuasar-11
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SL
L3.1 8B Slush
Slush · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
llama3 diverce ver1.0 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
RoleplayTool use
LL
OpenBioLLM-Llama3-8B
Llama · nitsuai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
Kocdigital LLM 8b v0.1 i1
Kocdigital · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · Joseph717171
Params8.03B
Context128K
Smallest6.9 GB
Tool use

Keep browsing