GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
NA
Narrly Gunnison CPU Ready v3
Narrly · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · phate334
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · Marlon81
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
medical triage llama 3.1 8b
Llama · hjogidasani
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PE
Persuasion_Simulation
Persuasion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3.1 sales
Llama · polarmackz
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange law
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Quantara Sentinel 8B
Llama · skyuu72
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 15 raftulu405b shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · antoste
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
sophosympatheia/New-Dawn-Llama-3.1-70B-v1.1
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Storm 8B
Llama · NikitaBaramiia
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.7 GB
Tool use
LL
waray llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
oh dcft v3 llama3.1 nemotron 70b shareGPT format
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
deepthought 8b llama v0.01 alpha
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
llama3.1 8b spaetzle v74
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · thamada
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tango 70b
Llama · sandbox-ai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BL
invisietch/L3.1-70Blivion-v0.1-rc1-70B
Blivion · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · reach-vb
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Code Summary Model Llama 3.1 8B Instruct 4bit
Llama · bestler
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
DU
L3.1 8B Dusky Ink Stock v0.1
Dusky · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 MFANN 8b Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
SO
Soulbound 8B
Soulbound · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Smallest4.7 GB
GGUF
ST
stackexchange engineering
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
gbueno86/Brinebreath-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
Ckoozzzu New3
New · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ST
stackexchange codereview
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding

Keep browsing