GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 Base NSFW pretrained e 0.5 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
TR
Triangulum v2 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
LL
Llama Poro 2 8B Long Base
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
LL
Llama 3.1 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama Guard 3 8B
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
LL
Llama3.1 8b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 5p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Artemis
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Pingala8 2bit
Llama · Genrius-AI
Params2.89B
Context128K
Smallest2.4 GB
GGUF
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
AD
Adversary 8B v1.22
Adversary · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3.1 8B EZO 1.1 it
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Joycaption Beta One Hf Llava
Llama · filvyb
Params8B
Context128K
Smallest6.6 GB
Vision
LL
Llama 3.1 8B MultiReflection Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
uzbek llama 3.1 8B instruct v2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Uncensored Complete
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
OpenMath2 Llama3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B EZO 1.1 it i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing