GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct
Llama · blogcncom
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · rachelkluu
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
sft full llama3.1 sci
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · eric-musa
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MA
MagpieLM 8B Chat v0.1 Q8 0
Magpielm · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 Tulu 3 8B Q8 0
Llama · KnutJaegersberg
Params8.03B
Context128K
Smallest8.5 GB
GGUF
SW
SwarmChat models
Swarmchat · Inventors-Hub
Params9.15B
Context128K
Q4_K_M4.9 GB
GGUF
LL
bicolano llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · raethehacker
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Ablation 127 Shisav2.Gbs128.5E6 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8B Instruct
Llama · zypher99
Params8.03B
Context128K
Smallest8.5 GB
Tool use
DE
Lyrical_MT_ru2en_1e_DeepSeekR1_Llama_8b
DeepSeek · AlekseyCalvin
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
LL
Cogito v1 Preview Llama 8B
Llama · WSDW
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Meta Llama 3.1 8B Instruct
Llama · Khushiee
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
deepthought 8b abliterated Q4 K M
Deepthought · Lucy-in-the-Sky
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
WI
Wingless_Imp_8B
Wingless · EloyOn
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · Wubbbi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instuct Uz Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.4 GB
Reasoning
LL
meta llama Llama 3.1 70B Instruct FP8
Llama · jesse-r-s-hines
Params7M
Context128K
Smallest0.0 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · tekiny
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 3.1 0x mini Q3 K S
Llama · ozone-research
Params8.03B
Context128K
Smallest3.7 GB
Tool use
LL
Llama 3.1 Amelia ACC 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ML
mlfoundations dev OH original wo airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · biosharp18
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AN
L3.1 8B Animus V12.1
Animus · Darkhn-Quants
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Thespis Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Roleplay
LL
Selene 1 Mini Llama 3.1 8B Q5 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.6 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llama 3.1 8B TrenerAI
Llama · tn122958ur
Params8.03B
Context128K
Smallest4.9 GB
Tool use

Keep browsing