GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · marcelone
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Llama3.1 8B Middo Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Nephilim Metamorphosis v1 8B
Llama · grimjim
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo slim orca 500k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ET
L3.1 EtherealRainbow v1.0 Rc1 8B
Etherealrainbow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Tess 3 Llama 3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 70B Instruct
Llama · jburmeister
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
ilsp.Llama Krikri 8B Instruct
Llama · DevQuasar-7
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
llama3.1 typhoon2 8b instruct
Llama · Float16-cloud
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 KoEn 8B Magic8
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hacker News Comments Summarization Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
FO
Foundation Sec 8B Chinese Chat
Foundation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Heretic V1 1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1.3 slim orca x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.25
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct abliterated
Llama · PocketWeights
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
New Dawn Llama3.1 70b v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Tulu 3 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
aisingapore/llama3.1-8b-cpt-sea-lionv3-base
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 metamath x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NA
Nano_Imp_1B
Nano · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Llama 3.1 8B Instruct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
MaziyarPanahi/calme-2.3-legalkit-8b
Calme · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin Llama 3.1 8B orpo v0.1 4bit
Llama · EpistemeAI
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
L3.1 Moe 4x8B v0.1 i1
Moe · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
Tool use
ML
mlfoundations dev oh v1.3 evol instruct x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing