GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Aeon Q4
Llama · yusuf3416
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Thinking R1
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama SEA LION v3.5 70B R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
VI
Vire Protocol 70b
Vire · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
llama 3.1 8b taiwan chat
Llama · steven0226
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
cogito v2 preview llama 405B i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
GGUF
LL
Llama 3.1 70B EZO 1.1 It
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8b DodoWild v2.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
ST
stackexchange crypto
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hercules 6.1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GA
GasAslan/C1-3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Instruct Ind Tax Act 1961
Llama · teclabs
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 30 rafathenev2.5epochs shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 129 Shisav2.Gbs128.2E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
HexaMind Llama 3.1 8B S21
Llama · s21mind
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hermes 3 Llama 3.1 8B
Llama · AbteeXAILab
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlfoundations dev hp ablations llama3 epoch1 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Nicefellow Reflection
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DeepDive 3 R1 Prev
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
llama3.1 8b spaetzle v51 GGUF 1
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AN
L3.1 70B Animus V14.0 5810 16.0
Animus · Darkhn-Quants-3
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LA
lapaliv 009
Lapaliv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 70b instruct 07 24
Llama · xaskasdf
Params70.6B
Context128K
Smallest27.6 GB
GGUF
BA
barc0 google cloude test 20k transduction gpt4omini lr1e 5 epoch2 seed100 3
Barc · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ML
mlfoundations dev oh teknium scaling down random 0.8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only slim orca 550k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Dolermed R1 V1.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Oh Dcft v3.1 Llama 3.3 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Literotica 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 81 bestofn.athenev2 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing