GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLAMA 3_8B_Unaligned_BETA
Llama · mradermacher
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
ST
stackexchange genai
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo camel ai chemistry
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · violetahayashi69
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Models Meta Llama Llama Guard 3 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
Coding
ML
mlfoundations dev oh v1.3 unnatural instructions x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama-3.1-8B-Instruct
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
Tool use
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Fusion 7030
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Amoral Cogito v1 Preview Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ML
mlfoundations dev oh v3 1 only platypus
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BR
Brisk Evolution 12B v0.1
Brisk · ReadyArt
Params12B
Context4192K
Q4_K_M7.3 GB
Roleplay
LL
Llama 3.1 8b DeepDive 3 R1 Prev v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
domestic yak 8B
Domestic · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1.3 unnatural instructions x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Poro 2 8B Long Base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
remember to breathe 8b Model Stock i1
Remember · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 EstLLM 8B Instruct 1125
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Smarteaz 0.2 R1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Magpie Align Llama 3.1 8B Magpie Align SFT v0.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Mlabonne Meta Llama 3.1 8B Instruct Abliterated
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 8b Hermedash R1 V1.04 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct GTAP v3 IQ3 XXS
Llama · DuoNeural
Params8.03B
Context128K
Smallest3.3 GB
Tool use

Keep browsing