GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Supernova Lite Instruct Merge Abliterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
Dolphin3 Cyber 8B
Dolphin · nbpedro315
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B RedQueenGuard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ektome_Llama 3.1 8B
Llama · Zynerji
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · starshina3003
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
WI
Wingless_Imp_8B_Abliterated
Wingless · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ektome Llama 3.1 8B PristinelyUncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
Barcenas 8b Cartas
Barcenas · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Fusion 8020
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Reddit Writer 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.3 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama SEA LION v3 8B IT
Llama · aisingapore
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ChatParts Llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · bullerwins
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 8B v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Magpie SFT Mix 800KMT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Middo Wizard
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
Dolphin X1 8B
Dolphin · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama PLLuM 8B Chat 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ReMaRk RedditV2 SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Reflection Llama 3.1 70B
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Dolphin3.0 Llama3.1 8B Abliterated
Llama · G4E-Unknown
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-notHumpback-M1-Rw-F-8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing