GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 Amelia ED 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 instruct bellman 8b swedish
Llama · neph1
Params8.03B
Context128K
Smallest4.0 GB
IM
Impish_Mind_8B
Impish · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
ContaLLM Beauty 8B Instruct
Contallm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 IgneousIguana 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Instruct 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 IgneousIguana 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo unreplicated
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MIST 1 70B
Mist · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SE
SelfCite 8B CC SFT
Selfcite · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Cantonese 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3.5 8B R
Llama · aisingapore
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down random 0.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama translate
Llama · dahara1
Params8.03B
Context128K
Smallest6.3 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · alex77coder
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct.immunized.v1
Llama · ApolloRaines
Params8B
Context128K
Q4_K_M4.9 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · hrm-labs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V13
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Krikri 8B Instruct i1
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · rktmeister
Params8.03B
Context128K
Smallest5.7 GB
LL
Dolphin Email 8b v2
Llama · h0ney-badger
Params8.03B
Context128K
Smallest5.7 GB
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Reasoning Llama 3.1 CoT RE1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 8B Distill CoT i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PN
L3.1 Pneuma 8B i1
Pneuma · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB