GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 70B Instruct lorablated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
Llama 3.1 8b Hermedive R1 V1.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Middo Wizard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SE
SelfCite 8B from CC
Selfcite · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
AstroSage 8B
Llama · AstroMLab
Params8.03B
Context128K
Smallest8.5 GB
NE
ckoozzzu/new3
New · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SillyTilly/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TE
BatirayErbayVodafone/testl
Testl · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Carvalho GL
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stanfm LMA3.1
Stanfm · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.19
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct Hi Fi
Llama · fraQtl
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct lorablated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Cogito v2 Preview Llama 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
ablation 49 rafathenev2.magpief shisa v2 llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nvidia/OpenMath2-Llama3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Mlx Community Llama 3.1 Nemotron 70B Instruct HF Bf16
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev OH DCFT V3 wo caseus custom
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 opengpt x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models Meta Llama Meta Llama 3.1 8B Instruct
Llama · jburmeister
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
OpenBuddy/openbuddy-nemotron-70b-v23.1-131k
Nemotron · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Gpt Oss 120b Distill Llama3.1 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 camel chemistry x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB