GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b Q5 K M
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama 3.1 Nemotron lorablated 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh teknium scaling down random 0.9
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange hardwarerecs
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 99 Bestofn.Atlo.Rp.Tlx Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
LL
hotep llm kush v91
Llama · hotepfederales
Params8.03B
Context128K
Q4_K_M4.9 GB
SW
L3.1 70b Swallow Saigetsu i1
Swallow · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
openthoughts3 1k llama3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DoberWild v2.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange gamedev
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Dolermed R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Gpt Oss 120b Distill Llama3.1 8B v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AN
AnasTySia/C-1
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Eurdem Defne llama3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SU
SuperHeart
Superheart · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.x 8b Smarteaz 0.2 R1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
livil/llama3.1-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
HuatuoSkywork O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PN
L3 Pneuma 8B
Pneuma · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta llama 3.1 8b instruct
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 8B Distill CoT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.1 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.1 70b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only unnatural instructions
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
AL
AlignXpert ICA Full
Alignxpert · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB