GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-NeuralHercules-5.0-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama3 8B Chinese Chat GGUF 4bit
Llama · shenzhi-wang
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Hermes-2-Theta-Llama-3-70B-32k
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
Tool use
LL
Llama3 ChatQA 1.5 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
LL
Pauper Llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-8b-Ita
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AF
Affectra 2 8B EQ
Affectra · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3 8B Instruct 262k i1
Llama · mradermacher
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B Chinese Chat
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-8B-DarkIdol-2.1-Uncensored-1048K
Llama · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3-8B-Magpie-Air-MT-SFT-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
Hermes 4 70B Heretic
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
AE
L3-NA-Aethora-15B
Aethora · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
Llama 3 6B v0
Llama · mradermacher
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
LL
llama 3 typhoon v1.5x 70b instruct i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OP
OpenBioLLm 70B i1
Openbiollm · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Youko 70b Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3-ChatQA-1.5-8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 German 8B 32k i1
Llama · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Lexi-Smaug-Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3-Med42-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Groq 70B Tool Use
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Llama-3-8B-Magpie-Align-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Code-Llama-Bagel-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
llama-3-Korean-Bllossom-8B
Llama · MLP-KTLim
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Stheno-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing