GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
simonycl llama 3.1 8b instruct armorm iter1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3 8B slerp med 262k
Llama · tensorblock
Params8.03B
Context256K
Smallest3.2 GB
GGUF
ME
ChenWeiLi/MedLlama-3-8B_DARE
Medllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Nvidia Llama3 ChatQA 1.5 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OR
orca mini v5 8b i1
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SC
L3-Scrambled-Eggs-On-Toast-8B
Scrambled · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
DI
DiarizationLM 8b Fisher v1
Diarizationlm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
VIRNECT/llama-3-Korean-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Brillibits/Instruct_Llama3_8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9-llama3-70b
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
BU
Bungo-L3-8B
Bungo · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 4194k
Llama · mradermacher
Params8.03B
Context1K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B alpaca fine tuning
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 EZO 8b Common it i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KISTI-KONI/KONI-Llama3-8B-20240630
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OpenBioLLM-Llama3-70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3 8b Cpt Sahabatai v1 Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct 1048k
Llama · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
NE
zeroblu3/NeuralPoppy-EVO-L3-8B
Neuralpoppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMa-3-CursedStock-v2.0-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
L3-70B-daybreak-abliterated-v0.4
Daybreak · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Galen-70B-v1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
L3.1 8B komorebi i1
Komorebi · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
RoleplayTool use
SN
L3 SnowStorm v1.15 4x8B B
Snowstorm · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
LL
Llama3 8b Cpt Sahabatai v1 Instruct
Llama · SkylarWhite
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
HO
HOTHUN Hermes 3 8B v1.4
Hothun · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
MohamedRashad/Arabic-Orpo-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UL
UltimateANJIR 8B L3 Blackroot
Ultimateanjir · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing