GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b Q5 K M
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
Coding
LL
Llama 3.1 Nemotron lorablated 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ML
mlfoundations dev oh teknium scaling down random 0.9
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange hardwarerecs
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 99 Bestofn.Atlo.Rp.Tlx Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
hotep llm kush v91
Llama · hotepfederales
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SW
L3.1 70b Swallow Saigetsu i1
Swallow · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
openthoughts3 1k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DoberWild v2.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange gamedev
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Dolermed R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Reasoning
LL
Gpt Oss 120b Distill Llama3.1 8B v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
AN
AnasTySia/C-1
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Eurdem Defne llama3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SU
SuperHeart
Superheart · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.x 8b Smarteaz 0.2 R1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
livil/llama3.1-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
RoleplayTool use
LL
HuatuoSkywork O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PN
L3 Pneuma 8B
Pneuma · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
meta llama 3.1 8b instruct
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 8B Distill CoT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
oh dcft v3.1 llama 3.1 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
oh dcft v3.1 llama 3.1 70b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
AL
AlignXpert ICA Full
Alignxpert · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing