GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
stackexchange mathematica
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange astronomy
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Tortoise i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Amelia AR 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 94 Gemma3.Rp.Tl Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
agentlans/Llama3.1-SuperDeepFuse
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange engineering
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 106 Bestofn.Atlo.Rp.Tlx25.Newmix1 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
DC
oh dcft v3.1 SN 405B hacky i1
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 8b instruct
Llama · lm-kit
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · AmpereComputing
Params8.03B
Context128K
Smallest5.0 GB
GGUF
LL
Natsumura Llama3.1 Base 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 07 raftulu70b shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Gloofy Emo 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
React Agent Coder Llama 3.1 8b
Llama · smarttasks
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
CH
ChatTea
Chattea · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Ko 4oDistil Heresy DARE
Llama · muzerai
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 MFANN 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ZE
ZEUS 8B V2
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ON
OncoLlama 3.1 8B Instruct 0.6 Imatrix
Oncollama · zachwel
Params8.03B
Context128K
Smallest3.3 GB
Tool use
LL
Tess R1 Limerick Llama 3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
VI
Vivian12300 new wiki model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1 2 only camel chemistry
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
SentientAGI.Dobby Mini Leashed Llama 3.1 8B
Llama · DevQuasar-9
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
openbuddy llama3.1 70b v22.2 131k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DO
Domestic Yak 8B
Domestic · LVSTCK
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Meta Llama Llama Guard 3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
8.1 python
Llama · bmaxin
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use

Keep browsing