GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Amelia ED 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 instruct bellman 8b swedish
Llama · neph1
Params8.03B
Context128K
Smallest4.0 GB
GGUF
IM
Impish_Mind_8B
Impish · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CO
ContaLLM Beauty 8B Instruct
Contallm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 IgneousIguana 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Instruct 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 IgneousIguana 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo unreplicated
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
MIST 1 70B
Mist · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SE
SelfCite 8B CC SFT
Selfcite · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Cantonese 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v3.5 8B R
Llama · aisingapore
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
ML
mlfoundations dev oh teknium scaling down random 0.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama translate
Llama · dahara1
Params8.03B
Context128K
Smallest6.3 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · alex77coder
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 8B Instruct.immunized.v1
Llama · ApolloRaines
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Roleplay
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · hrm-labs
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
ZE
ZEUS 8B V13
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Krikri 8B Instruct i1
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · rktmeister
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Dolphin Email 8b v2
Llama · h0ney-badger
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 8B Distill CoT i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PN
L3.1 Pneuma 8B i1
Pneuma · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing