GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 70B Instruct lorablated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
Llama 3.1 8b Hermedive R1 V1.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama3.1 8B Middo Wizard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SelfCite 8B from CC
Selfcite · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B EZO 1.1 It
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
AstroSage 8B
Llama · AstroMLab
Params8.03B
Context128K
Smallest8.5 GB
GGUF
NE
ckoozzzu/new3
New · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
SillyTilly/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
TE
BatirayErbayVodafone/testl
Testl · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Carvalho GL
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stanfm LMA3.1
Stanfm · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.19
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Instruct Hi Fi
Llama · fraQtl
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B Instruct lorablated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Cogito v2 Preview Llama 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
ablation 49 rafathenev2.magpief shisa v2 llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
nvidia/OpenMath2-Llama3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Mlx Community Llama 3.1 Nemotron 70B Instruct HF Bf16
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo caseus custom
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 opengpt x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 8B Instruct
Llama · jburmeister
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
OpenBuddy/openbuddy-nemotron-70b-v23.1-131k
Nemotron · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Gpt Oss 120b Distill Llama3.1 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
ML
mlfoundations dev oh v1.3 camel chemistry x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing