GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · backyardai
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 EIRAI 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.22.1 i1
Mfannv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · fedric95
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 405B
Llama · bartowski
Params406B
Context128K
Q4_K_M243.1 GB
LL
Gpt Oss 120b Distill Llama3.1 8B v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · Orenguteng
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Llama 3.1 EstLLM 8B Instruct 0825
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Magpie Align v0.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Tess R1 Limerick Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama3.1 kartoffeldes 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama Ione 8B Roleplay v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated Sabresooth
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 ARC Potpourri Induction 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · akjindal53244
Params8.03B
Context128K
Q4_K_M4.9 GB
FO
Foundation Sec 8B Chinese Chat
Foundation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Kita258
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Meditron3 8B
Meditron · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KokoroChat High i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
deepthought 8b llama v0.01 alpha i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB