GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
WIP Acacia 8B Model Stock
Wip · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Kin120300
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange gardening
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Oh Dcft v3.1 Llama 3.1 Nemotron 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ZE
ZEUS 8B V8
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dolphin 3.0 Llama 3.1 8B
Llama · fengjunbigboss
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
DC
oh dcft v3.1 claude 3 5 haiku 20241022 Q8 0
Dcft · roleplaiapp
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · riqalter
Params8.03B
Context128K
Smallest3.7 GB
Roleplay
DI
L3.1 Diffbot Small 2412
Diffbot · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
unsloth/Reflection-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Ablation 100 Bestofn.Atlo.Rp.Tlx50 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 0
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
llama 3.1 0x mini Q4 K M
Llama · ozone-research
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Thespis Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 Tulu 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
stackexchange stats
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Open Finance 8B
Llama · michaeld03
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HA
Hack_Questions_And_Answar
Hack · doctorgaming
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
Llama3.1 LexiHermes SuperStorm
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange physics
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · jimmylam6666
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Guard 3 8B
Llama · GuardwallAI
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 05 bs2ga4 shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev openthoughts3 100k llama3
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
MF
MFANNv0.20
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
AR
ArlowGPT 8B
Arlowgpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · lexuanbach
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8b Dolermed R1 V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use

Keep browsing