GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
MY
MythoNemo L3.1 70B v1.0
Mythonemo · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
DO
DongfuJiang prm version2 subsample no ref hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH original wo evol instruct 70k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Zhengyi.LLaMA Mesh
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WI
Wingless Alice RP NSFW 8B
Wingless · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
sparsh35/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B SFT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo evol instruct 140k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3.1 8B
Llama · mu2solutions
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B MOTH
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b DeepDive 3 R1 Prev i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
lordjia/Llama-3.1-Cantonese-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
remember to breathe 8b Model Stock
Remember · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
deval-core/base-eval
Base · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
KoBioMed Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v3 1 only collective cognition
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
DC
oh dcft v1.3 no curation gpt 4o mini scale 0.5x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Spark
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 KokoroChat High
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
stackexchange security
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 alpaca x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev alpaca inst gen 4omini resp gen gpt4o shareGPT format
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 camel math x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 137 Shisav2.Gbs128.1.4E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
BR
BrownLoafers 70B
Brownloafers · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3 1 70B Instruct Base
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8b DoberWild v2.02 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
oh dcft v3.1 llama 3.3 70b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
prithivMLmods.Megatron Opus 14B 2.0
Megatron · DevQuasar-2
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF

Keep browsing