GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-8B-Stroganoff
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HI
HiroseKoichi/L3-8B-Lunar-Stheno
Hirosekoichi · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Strawberrylemonade L3 70B v1.2 Heretic
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
HeshamHaroon/llama-3-instruct-slerp-arabic
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Ko 8B OpenOrca
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-Guard-2-8B-German
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AB
TheSkullery/AbL3In-15B
Abl · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
llama 3 typhoon v1.5 8b instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Awanllm-Llama-3-8B-Dolfin-v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · lmstudio-community
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CE
L3-8B-Celeste-v1
Celeste · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OL
Olethros 8B
Olethros · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
tokyotech-llm/Llama-3-Swallow-70B-Instruct-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
meta-llama/Meta-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LlamaREST EX
Llama · codingsoo
Params8.03B
Context8K
Smallest1.3 GB
GGUF
LL
Hermes 3 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest1.9 GB
RoleplayTool use
LU
L3-8B-Lunaris-v1
Lunaris · naverick
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
xiangxinai Xiangxin 2XL Chat 1048k Chinese Llama3 70B
Llama · RichardErkhov
Params70.6B
Context1024K
Q4_K_M42.5 GB
GGUF
LL
tongliuphysics Llama0 3 8b v0.1 p 2 lr1e 6 e1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UM
L3 Umbral Mind RP v1.0 8B
Umbral · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
CO
Code Millenials 8b
Code · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 Distilled
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Turkish Llama 8b DPO v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 PBM Nova 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 15b Instruct
Llama · mradermacher
Params15.4B
Context8K
Q4_K_M9.4 GB
GGUF
OP
OpenBioLLm 70B
Openbiollm · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3 DiscoLeo Instruct 8B 32k v0.1
Llama · GPT4All-Community
Params8.03B
Context64K
Q4_K_M5.5 GB
GGUF
LL
m42-health/Llama3-Med42-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PE
L3-Persephone-8B-v1.0
Persephone · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
tokyotech-llm/Llama-3-Swallow-70B-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF

Keep browsing