GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
stackexchange biology
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CK
ckoozzzu/dl6
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Hermedive R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
ML
mlfoundations dev OH DCFT V3 wo gpt4 llm
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Zhengyi LLaMA Mesh
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ML
mlfoundations dev oh v1.3 airoboros x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
FI
Models TheFinAI Fino1 8B
Fino · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · xaskasdf
Params70.6B
Context128K
Smallest18.1 GB
Tool use
ST
stackexchange physics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange space
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 metamath x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DodoWild v2.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ORANSight LLama 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mpasila Llama 3.1 Literotica 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Hermedive V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TI
TINA AI3.2
Tina · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8B Lexi Uncensored V2 Q8 0
Llama · goodasdgood
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
meta-llama/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange softwareengineering
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Karma Electric Llama31 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dolphin 3.0 Llama 3.1 8B
Llama · Parje3t
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
oh dcft v3.1 llama 3.1 405b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct lollmsformat
Llama · ParisNeo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 8b cantonese gguf v3
Llama · Ans0nWr0ng
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
flammenai Mahou 1.5 llama3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CL
L3.1 ClaudeMaid 4x8B
Claudemaid · xxx777xxxASD
Params24.9B
Context128K
Smallest12.1 GB
GGUF
LL
KONI Llama3.1 70B Instruct 20241115
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing