GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Base NSFW pretrained e 0.5 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
TR
Triangulum v2 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Llama Poro 2 8B Long Base
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Llama 3.1 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama Guard 3 8B
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LL
Llama3.1 8b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 5p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Artemis
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Pingala8 2bit
Llama · Genrius-AI
Params2.89B
Context128K
Smallest2.4 GB
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
AD
Adversary 8B v1.22
Adversary · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Joycaption Beta One Hf Llava
Llama · filvyb
Params8B
Context128K
Smallest6.6 GB
LL
Llama 3.1 8B MultiReflection Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
uzbek llama 3.1 8B instruct v2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Uncensored Complete
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
OpenMath2 Llama3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B EZO 1.1 it i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB