GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · marcelone
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama3.1 8B Middo Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Nephilim Metamorphosis v1 8B
Llama · grimjim
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo slim orca 500k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ET
L3.1 EtherealRainbow v1.0 Rc1 8B
Etherealrainbow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Tess 3 Llama 3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 camel biology x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models Meta Llama Meta Llama 3.1 70B Instruct
Llama · jburmeister
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
ilsp.Llama Krikri 8B Instruct
Llama · DevQuasar-7
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
llama3.1 typhoon2 8b instruct
Llama · Float16-cloud
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KoEn 8B Magic8
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hacker News Comments Summarization Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
FO
Foundation Sec 8B Chinese Chat
Foundation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic V1 1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 slim orca x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.25
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct abliterated
Llama · PocketWeights
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
New Dawn Llama3.1 70b v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
aisingapore/llama3.1-8b-cpt-sea-lionv3-base
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 metamath x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
NA
Nano_Imp_1B
Nano · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CA
MaziyarPanahi/calme-2.3-legalkit-8b
Calme · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin Llama 3.1 8B orpo v0.1 4bit
Llama · EpistemeAI
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
L3.1 Moe 4x8B v0.1 i1
Moe · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ML
mlfoundations dev oh v1.3 evol instruct x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB