GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Mahou-1.2a-llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 70B ShiningValiant2 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
MMedS Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grimjim Llama 3 Instruct demi merge 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama-3-spicy-abliterated-stella-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-64k
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen 3.5 9b
Qwen · protocolsyncllc
Params9.2B
Context256K
Smallest9.8 GB
ReasoningTool use
LL
llama3-8B-DarkIdol-1.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3 70B Orpo v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
haqishen Llama 3 8B Japanese Instruct
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Mahou-1.3-llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Stroganoff 4.0 Version A
Llama · mradermacher
Params8B
Context10K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct-abliterated-v3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-8B-Instruct-abliterated-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-8B-DarkIdol-2.1-Uncensored-32K
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3-Stheno-Instruct-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-WhiteRabbitNeo-8B-v2.0
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OpenBioLLM Llama3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3-Preferred-MedSwallow-70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Mahou 1.3 llama3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b It Translation Sharegpt En Ko
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Llama-3-Taiwan-8B-Instruct
Llama · phate334
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B DarkIdol 2.3 Uncensored 32K i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
ST
Strawberrylemonade L3 70B v1.2
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
ORLM LLaMA 3 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing