GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 70B Instruct
Llama · DevQuasar-4
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · ArliAI
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo slim orca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Enigma
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v3.1 claude 3 5 haiku 20241022
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct TTS Phonetic Denglish
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo glaive code assistant
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev oh dcft v3 llama3.1 nemotron 70b shareGPT format
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
WA
WangchanLION v3
Wangchanlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 w v3 metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 8b Big Alpaca Uncensored
Llama · Stormtrooperaim
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 1p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
NousResearch/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
LL
SentientAGI.Dobby Mini Unhinged Plus Llama 3.1 8B
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 airoboros x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Natsumura Assistant 1.1 Llama 3.1 8b
Llama · tohur
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta_Llama_3.1_8b_it
Llama · Nexesenex
Params8.03B
Context128K
Smallest2.9 GB
MI
MIST 1 70B
Mist · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
cogito-v1-preview-llama-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · FunnyPunch
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
IeBoytsov llama3 1 ox llms 8b sft only germany data and ultrafeedback
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K M
Llama · asjdoij
Params8.03B
Context128K
Q4_K_M4.9 GB