GGUF models: llama3 license

3439 GGUF models listed under the llama3 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 406B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 Cantonese 8B Instruct
Llama · lordjia
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama3 8B DarkIdol 2.2 Uncensored 1048K B
Llama · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
GGUF
LL
Llama3 8b It Prometheus Ko
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3
Llama · cortexso
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
badger-iota-llama-3-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.1 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CE
cerberus-v0.1
Cerberus · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DO
Doctor_Horror 3.2 1B
Doctor · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
UN
Uncle L3 8b Merged v3
Uncle · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
StrawberryLemonade L3 70B v1.0
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
llama3 8b chat brainstorm v2.1
Llama · DevQuasar
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
klcsp llama3 8b fft classification 11 v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SU
L3.1 8B sunfall stheno v0.6.1 i1
Sunfall · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llamagnific-3-87b
Llama · mradermacher
Params86.8B
Context8K
Smallest32.2 GB
GGUF
OR
Orca_Mini_V6_8B
Orca · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 typhoon v1.5x 70b instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Hercules 5.0 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BI
BigWeave v31 96b i1
Bigweave · mradermacher
Params96.2B
Context8K
Smallest20.7 GB
GGUF
LL
nyun-c1-llama3-62B
Llama · mradermacher
Params62B
Context8K
Q4_K_M37.3 GB
GGUF
LL
Bllossom70B
Llama · DevQuasar-10
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2.1 Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
badger kappa llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3-German-8B-32k
Llama · mayflowergmbh
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B ProLong 512k Base
Llama · mradermacher
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B DarkIdol 2.2 Uncensored 1048K B
Llama · matrixportalx
Params8.03B
Context1024K
Q4_K_M4.9 GB
Roleplay
LL
DeepHermes Egregore v2 RLAIF 8b Atropos
Llama · NousResearch
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
arcee-ai/Llama-3.1-SuperNova-Lite
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Stroganoff 4.0
Llama · mradermacher
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF

Keep browsing