GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Bonsaikraft 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FI
BrewInteractive/fikri-3.1-8B-Instruct
Fikri · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Fusion 8020
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama VARCO 8B Instruct LLaMAfied
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B nicefellow reflection chatml
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dobby Mini Unhinged Plus Llama 3.1 8B
Llama · SentientAGI
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
expertai/SLIMER-LLaMA3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
oh dcft v3.1 llama 3.2 3b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev evol tt 2s
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Aleph
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
CL
L3.1 Clouded Uchtave v0.1 8B
Clouded · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
NA
Nano_Imp_1B
Nano · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
HE
Heaven 1.1 Base
Heaven · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek llama3.1 HARI 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
MagpieLM 8B SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
behbudiy Llama 3.1 8B Instuct Uz
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BA
Barcenas 8b Juridico Mexicano
Barcenas · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Thespis Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Nephilim Metamorphosis v2 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev alpaca inst gen 4o resp gen gpt4o mini shareGPT format
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Finance
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1.3 slim orca x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B SFT
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange photo
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Chinese sft medical
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
scb10x llama3.1 typhoon2 8b instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use

Keep browsing