GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
WA
WangchanLION v3 IT i1
Wangchanlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
SLIMER PARALLEL LLaMA3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Infinity Instruct 7M 0729 Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8b instruct LLMPC Red Team i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · mradermacher
Params6.29B
Context128K
Q4_K_M3.9 GB
GGUF
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
bella bartender 8b llama3.1
Llama · juiceb0xc0de
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange reverseengineering
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DP
DPE 70b Ckpts
Dpe · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplay
LL
Llama 3.1 Swallow 8B Instruct v0.1
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B EZO 1.1 it
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 8B v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BR
Brisk Evolution 12B v0.1
Brisk · bartowski
Params12B
Context4192K
Q4_K_M7.5 GB
Roleplay
LL
MFANN llama3.1 abliterated SLERP v3.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Abliterated Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Base NSFW pretrained e 0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hacker News Comments Summarization Llama 3.1 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
PULI LlumiX Llama 3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Esmeralda Llama 3.1 8B Control
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct.immunized.v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AS
Assistant_Pepe_70B
Assistant · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing