GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.1 SuperNovaLite HuatuoSkywork O1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh teknium scaling down random 0.2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Theia Llama 3.1 8B v1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Gemma 2 27b ORPO iter3 i1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ML
mlfoundations dev oh v1.3 alpaca x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Locutusque/Apollo-0.4-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · GPT4All-Community
Params8.03B
Context128K
Smallest5.3 GB
ReasoningTool use
LL
Llama 3.1 8B GRA Condor
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
deepthought 8b llama v0.01 alpha
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · OwenArli
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ST
stackexchange pets
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1.3 opengpt x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Huihui ai.Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · DevQuasar-8
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
ML
mlfoundations dev oh v1.3 camel chemistry x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange music
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ZE
ZEUS 8B V7
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
ZE
ZEUS 8B V22
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
II Tulu 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
deepthought 8b abliterated
Deepthought · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 46 rafathenev2.rp shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
TitanForge 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only gpteacher
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama O 3.1 8B levent
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Locutusque/Hercules-6.1-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MY
MythoNemo L3.1 70B v1.0 i1
Mythonemo · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Llama 3.1 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev oh v1.3 camel math x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama capro
Llama · teclabs
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing