GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · DevQuasar-4
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · ArliAI
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo slim orca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Enigma
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DC
oh dcft v3.1 claude 3 5 haiku 20241022
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct TTS Phonetic Denglish
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Swallow 8B v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo glaive code assistant
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
mlfoundations dev oh dcft v3 llama3.1 nemotron 70b shareGPT format
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WA
WangchanLION v3
Wangchanlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1 w v3 metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 8b Big Alpaca Uncensored
Llama · Stormtrooperaim
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 1p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
NousResearch/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
SentientAGI.Dobby Mini Unhinged Plus Llama 3.1 8B
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1.3 airoboros x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Natsumura Assistant 1.1 Llama 3.1 8b
Llama · tohur
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Meta_Llama_3.1_8b_it
Llama · Nexesenex
Params8.03B
Context128K
Smallest2.9 GB
Tool use
MI
MIST 1 70B
Mist · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
cogito-v1-preview-llama-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
LL
LLAMA 3_8B_Unaligned_BETA
Llama · FunnyPunch
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
IeBoytsov llama3 1 ox llms 8b sft only germany data and ultrafeedback
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K M
Llama · asjdoij
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing