GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Bonsaikraft 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
BrewInteractive/fikri-3.1-8B-Instruct
Fikri · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Fusion 8020
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B nicefellow reflection chatml
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Unhinged Plus Llama 3.1 8B
Llama · SentientAGI
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
expertai/SLIMER-LLaMA3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.2 3b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev evol tt 2s
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Aleph
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CL
L3.1 Clouded Uchtave v0.1 8B
Clouded · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NA
Nano_Imp_1B
Nano · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
HE
Heaven 1.1 Base
Heaven · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek llama3.1 HARI 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MagpieLM 8B SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
behbudiy Llama 3.1 8B Instuct Uz
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
Barcenas 8b Juridico Mexicano
Barcenas · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Thespis Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Nephilim Metamorphosis v2 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev alpaca inst gen 4o resp gen gpt4o mini shareGPT format
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Finance
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 slim orca x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange photo
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Chinese sft medical
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
scb10x llama3.1 typhoon2 8b instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB