GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
ST
stackexchange biology
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CK
ckoozzzu/dl6
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Hermedive R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ML
mlfoundations dev OH DCFT V3 wo gpt4 llm
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Zhengyi LLaMA Mesh
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev oh v1.3 airoboros x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
FI
Models TheFinAI Fino1 8B
Fino · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Meta Llama 3.1 70B Instruct
Llama · xaskasdf
Params70.6B
Context128K
Smallest18.1 GB
ST
stackexchange physics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange space
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 metamath x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DodoWild v2.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ORANSight LLama 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mpasila Llama 3.1 Literotica 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Hermedive V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TI
TINA AI3.2
Tina · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q8 0
Llama · goodasdgood
Params8.03B
Context128K
Smallest8.5 GB
LL
meta-llama/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange softwareengineering
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Karma Electric Llama31 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · Parje3t
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.1 405b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct lollmsformat
Llama · ParisNeo
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 8b cantonese gguf v3
Llama · Ans0nWr0ng
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
flammenai Mahou 1.5 llama3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
CL
L3.1 ClaudeMaid 4x8B
Claudemaid · xxx777xxxASD
Params24.9B
Context128K
Smallest12.1 GB
LL
KONI Llama3.1 70B Instruct 20241115
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB