GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct DeepRefusal Broken
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-4194k
Llama · leafspark
Params8B
Context1K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · bartowski
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 gutenberg 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 JPRP NSFW 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ReasoningRoleplay
LL
Llama 3 Taiwan 8B Instruct
Llama · chienweichang
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-WildChat
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA3 Reasoning
Llama · mradermacher
Params157M
Context128
Q4_K_M0.1 GB
Reasoning
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k GGUF v2
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
aixsatoshi Llama 3 8b Cosmopedia japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct RR Abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Xiangxin 2XL Chat 1048k Chinese Llama3 70B i1
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
GGUF
LE
LexiFreak 8B Unleashed
Lexifreak · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3-Umievo-Shizuko-sqlcoder-2x8B
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
Coding
LL
llama-3-cat-8b-instruct-v1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Cantonese-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Gutenberg 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3 German 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Giraffe-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Neurona-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama-3-Groq-8B-Tool-Use
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Hermes-2-Theta-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 8B Instruct Finance RAG
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-abliterated-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
medicine Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-spicy-abliterated-stella-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CO
Cosmos 8B Instruct SFT
Cosmos · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing