GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Lexi Uncensored V2 Q6 K
Llama · Spaceballs
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Llama 3.1 Tulu 3 70B DPO
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ZE
ZEUS 8B V13
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ZE
ZEUS 8B V13
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3.1 kartoffeldes 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Llama 3.1 8B Lexi Uncensored V2 apostate
Llama · Spaceballs
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct
Llama · poisson-fish
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MA
magpielm 8b chat v0.1
Magpielm · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dolphin 3.0 Llama 3.1 8B
Llama · single2332
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
RE
ref 70 e3
Ref · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
TH
L3.1 Theory of mind 8B
Theory · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mox tiny 1
Llama · vanta-research
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Llama 3.1 Tulu 3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 Tulu 3 70B Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ST
stackexchange avp i1
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
New Dawn Llama 3.1 70B v1.1
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B Instruct UD OQ8 0 F32.EQ8 0 F32.IQ4 K Q8 0
Llama · Joseph717171
Params8.03B
Context128K
Smallest7.4 GB
Tool use
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ZE
ZEUS 8B V2
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
calme-2.3-llama3.1-70b
Llama · NexesQuants
Params70.6B
Context128K
Smallest34.8 GB
GGUF
LL
Llama Nephilim Metamorphosis v2 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 Nemotron 70B Instruct HF Q4 K M
Llama · roleplaiapp
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingRoleplayTool use
LL
IeBoytsov llama3 1 ox llms 8b sft full 3 epochs
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Theia Llama 3.1 8B v1.1
Llama · Chainbase-Labs
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Uncensored DeLMAT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
leafspark Llama 3.1 8B MultiReflection Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing