GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
NA
Narrly Gunnison CPU Ready v3
Narrly · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B Instruct
Llama · phate334
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · Marlon81
Params8.03B
Context128K
Smallest5.7 GB
LL
medical triage llama 3.1 8b
Llama · hjogidasani
Params8.03B
Context128K
Q4_K_M4.9 GB
PE
Persuasion_Simulation
Persuasion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 sales
Llama · polarmackz
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange law
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Quantara Sentinel 8B
Llama · skyuu72
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 15 raftulu405b shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · antoste
Params8.03B
Context128K
Smallest4.7 GB
LL
sophosympatheia/New-Dawn-Llama-3.1-70B-v1.1
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Storm 8B
Llama · NikitaBaramiia
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.7 GB
LL
waray llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
LL
oh dcft v3 llama3.1 nemotron 70b shareGPT format
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
deepthought 8b llama v0.01 alpha
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
llama3.1 8b spaetzle v74
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · thamada
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tango 70b
Llama · sandbox-ai
Params70.6B
Context128K
Q4_K_M42.5 GB
BL
invisietch/L3.1-70Blivion-v0.1-rc1-70B
Blivion · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B
Llama · reach-vb
Params8.03B
Context128K
Smallest3.2 GB
LL
Code Summary Model Llama 3.1 8B Instruct 4bit
Llama · bestler
Params8.03B
Context128K
Q4_K_M4.9 GB
DU
L3.1 8B Dusky Ink Stock v0.1
Dusky · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 MFANN 8b Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
SO
Soulbound 8B
Soulbound · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Smallest4.7 GB
ST
stackexchange engineering
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
gbueno86/Brinebreath-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
NE
Ckoozzzu New3
New · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ST
stackexchange codereview
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB