GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Ablation 97 Geniac Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Diffbot Small 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
Mercury In Retrograde ALT 8b Model Stock
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Models Meta Llama Meta Llama 3.1 405B Instruct
Llama · jburmeister
Params410B
Context128K
Smallest151.2 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Instruct Artex
Llama · ARTEXIT
Params8.03B
Context128K
Smallest5.7 GB
Reasoning
LL
tokyotech llm Llama 3.1 Swallow 70B v0.1
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
openbuddy llama3.1 70b v22.2 131k i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Ablation 105 Bestofn.Atlo.Rp.Tlx25.Newmixall Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
CY
CybersecurityRiskAnalyst
Cybersecurityriskanalyst · saki007ster
Params8.03B
Context128K
Smallest4.7 GB
GGUF
DC
oh dcft v3.1 claude 3 5 haiku 20241022 Q6 K
Dcft · roleplaiapp
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
ablation 25 reasoning shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Ablation 136 Shisav2.Gbs128.1.2E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
DC
oh dcft v3 sharegpt format sedrick
Dcft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
VI
Vivian12300 en sw wiki en
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 MedIT SUN 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · deven367
Params8.03B
Context128K
Smallest5.7 GB
GGUF
DC
oh dcft v1.2 no curation gpt 4o mini
Dcft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
RedHatAI Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Models Meta Llama Meta Llama 3.1 8B Instruct
Llama · Yannlaff
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Herrsimian 8B
Llama · knifeayumu
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PN
L3.1 Pneuma 8B 0429
Pneuma · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct bnb 4bit shqip Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
NO
nothingiisreal L3.1 8B Celeste V1.5
Nothingiisreal · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
BI
BioMed R1 8B
Biomed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DO
Dolphin X1 8B
Dolphin · Iambackup
Params8.03B
Context128K
Smallest8.5 GB
Tool use
ML
mlfoundations dev oh v1.3 camel math x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange stackoverflow
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing