GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
WA
WangchanLION v3 IT i1
Wangchanlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SLIMER PARALLEL LLaMA3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M 0729 Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8b instruct LLMPC Red Team i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 Elm Turbo 6B Instruct
Llama · mradermacher
Params6.29B
Context128K
Q4_K_M3.9 GB
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
bella bartender 8b llama3.1
Llama · juiceb0xc0de
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange reverseengineering
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DP
DPE 70b Ckpts
Dpe · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Swallow 8B Instruct v0.1
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BR
Brisk Evolution 12B v0.1
Brisk · bartowski
Params12B
Context4192K
Q4_K_M7.5 GB
LL
MFANN llama3.1 abliterated SLERP v3.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Abliterated Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Base NSFW pretrained e 0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hacker News Comments Summarization Llama 3.1 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
PULI LlumiX Llama 3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Esmeralda Llama 3.1 8B Control
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct.immunized.v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Assistant_Pepe_70B
Assistant · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 8B ShiningValiant2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB