GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3.1 SuperNova Lite
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GE
medgap gemma 4 12b
Gemma · protocolsyncllc
Params11.9B
Context256K
Smallest0.5 GB
ReasoningTool useVision
LL
Collaiborator-MEDLLM-Llama-3-8B-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 ELYZA JP 8B
Llama · elyza
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
RoleplayTool use
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
HE
NousResearch.Hermes 4 405B
Hermes · DevQuasar-13
Params405B
Context128K
Q4_K_M243.1 GB
Tool use
LL
lightblue suzume llama 3 8B japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Trendyol LLM 8b Chat v2.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Ultra Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Turkish Llama 8b Instruct v0.1
Llama · ytu-ce-cosmos
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-70B-Instruct-abliterated
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
ET
Eternal.Bondange 3.2 1B
Eternal · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
dolphin-2.9.1-llama-3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
BA
BanglaLLama-3-8b-BnWiki-Base
Banglallama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Open Insurance LLM Llama3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B ProLong 64k Base
Llama · RichardErkhov
Params8B
Context64K
Q4_K_M4.9 GB
GGUF
LL
NousResearch DeepHermes 3 Llama 3 3B Preview
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningRoleplayTool use
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.3 70B Instruct ablated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
CaptureTheFlag CypherMindLLM XRLAB
Llama · ErenAta00
Params8B
Context128K
Smallest6.6 GB
GGUF
LL
llama3-8B-DarkIdol-2.1-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
Roleplay
LL
Llama3 German 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing