GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8b Instruct Ind Tax Act 1961 Optimal
Llama · teclabs
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 TitanDeluxe 8B Slerp
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DP
DPE 70b Ckpts
Dpe · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplay
LL
oh dcft v3.1 llama 3.1 nemotron 70b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Cogito v1 Preview Llama 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
ablation 04 bs4ga2 shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · trinhvanhung
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 43 rewild shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo evol instruct 140k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 1 8b mlfoundations dev stackexchange scifi i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Models Chainbase Labs Theia Llama 3.1 8B v1.1
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
LL
context-labs/Meta-Llama-3.1-8B-Instruct-FP16
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama SEA Guard 8B 2602
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama PLLuM 8B Base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo camel ai biology
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 13b chat PolicyPro
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
LlamaAligned DeepSeekR1 Distill 8b
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
CE
L3.1 8B Celeste V1.5 i1
Celeste · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Models NousResearch Meta Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · Sangto
Params8.03B
Context128K
Smallest8.5 GB
Roleplay
LL
Meta Llama 3.1 8B Instruct
Llama · leafspark
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 8B nicefellow reflection r1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama3.1 Cantonese 8B Instruct
Llama · lordjia
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8b Hermedash R1 V1.04
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
BAAI/Infinity-Instruct-7M-Gen-Llama3_1-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
WI
Wingless_Imp_8B_Abliterated
Wingless · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange parenting
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing