GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Ablation 97 Geniac Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Diffbot Small 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Mercury In Retrograde ALT 8b Model Stock
Mercury · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models Meta Llama Meta Llama 3.1 405B Instruct
Llama · jburmeister
Params410B
Context128K
Smallest151.2 GB
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Instruct Artex
Llama · ARTEXIT
Params8.03B
Context128K
Smallest5.7 GB
LL
tokyotech llm Llama 3.1 Swallow 70B v0.1
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
openbuddy llama3.1 70b v22.2 131k i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Ablation 105 Bestofn.Atlo.Rp.Tlx25.Newmixall Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CY
CybersecurityRiskAnalyst
Cybersecurityriskanalyst · saki007ster
Params8.03B
Context128K
Smallest4.7 GB
DC
oh dcft v3.1 claude 3 5 haiku 20241022 Q6 K
Dcft · roleplaiapp
Params8.03B
Context128K
Smallest6.6 GB
LL
ablation 25 reasoning shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 136 Shisav2.Gbs128.1.2E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v3 sharegpt format sedrick
Dcft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
VI
Vivian12300 en sw wiki en
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 MedIT SUN 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · deven367
Params8.03B
Context128K
Smallest5.7 GB
DC
oh dcft v1.2 no curation gpt 4o mini
Dcft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
RedHatAI Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Models Meta Llama Meta Llama 3.1 8B Instruct
Llama · Yannlaff
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Herrsimian 8B
Llama · knifeayumu
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PN
L3.1 Pneuma 8B 0429
Pneuma · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct bnb 4bit shqip Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
NO
nothingiisreal L3.1 8B Celeste V1.5
Nothingiisreal · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
BI
BioMed R1 8B
Biomed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
Dolphin X1 8B
Dolphin · Iambackup
Params8.03B
Context128K
Smallest8.5 GB
ML
mlfoundations dev oh v1.3 camel math x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange stackoverflow
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB