GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8b Instruct Ind Tax Act 1961 Optimal
Llama · teclabs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 TitanDeluxe 8B Slerp
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DP
DPE 70b Ckpts
Dpe · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
oh dcft v3.1 llama 3.1 nemotron 70b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Cogito v1 Preview Llama 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
ablation 04 bs4ga2 shisa v2 llama3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · trinhvanhung
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 43 rewild shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo evol instruct 140k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 1 8b mlfoundations dev stackexchange scifi i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models Chainbase Labs Theia Llama 3.1 8B v1.1
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
context-labs/Meta-Llama-3.1-8B-Instruct-FP16
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA Guard 8B 2602
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Llama PLLuM 8B Base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo camel ai biology
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 13b chat PolicyPro
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
DE
LlamaAligned DeepSeekR1 Distill 8b
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CE
L3.1 8B Celeste V1.5 i1
Celeste · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models NousResearch Meta Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · Sangto
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · leafspark
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8B nicefellow reflection r1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Cantonese 8B Instruct
Llama · lordjia
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 8b Hermedash R1 V1.04
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
BAAI/Infinity-Instruct-7M-Gen-Llama3_1-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
WI
Wingless_Imp_8B_Abliterated
Wingless · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange parenting
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB