GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
reflection llama 3.1 8B Solshine trainround4 16bit Q4 K M
Llama · Solshine
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
VI
Vivian12300 top ft model
Vivian · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
CY
cyber model
Cyber · xetrao08
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
lora llama8b aurora baseline 2026 05 02
Llama · johnoconnor0
Params7M
Context—
Smallest0.0 GB
GGUF
LL
Llama 3.1 AlternateTokenizer
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
ST
stackexchange money
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 1 8b mlfoundations dev stackexchange sports
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 45 rewild.rafathenev2.rp shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Ablation 128 Shisav2.Gbs128.1E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
AL
AlignXpert PBA Full
Alignxpert · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hacker News Comments Summarization Llama 3.1 8B Instruct
Llama · georgeck
Params8.03B
Context128K
Smallest5.5 GB
Tool use
LL
CYFRAGOVPL Llama PLLuM 8B Chat
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · Simplismart
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AS
Aspire V2 ALT ROW 8B Model Stock
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange cseducators
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackoverflow 25000tasks .75p
Stackoverflow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange literature
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange hsm
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange hermeneutics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AS
Assistant_Pepe_8B
Assistant · Pdf2548
Params8.04B
Context1048K
Q4_K_M4.9 GB
GGUF
LL
BAAI Infinity Instruct 7M Gen Llama3_1 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
OR
orca agentinstruct 1M v1 cleaned
Orca · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama31 8b poker mix v1 step10k Q4 K M
Llama · XueZhaAllen
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Code Summary Model Llama 3.1 8B Instruct 4bit
Llama · bestler
Params8.03B
Context128K
Smallest16.1 GB
GGUF
OR
orbit z
Orbit · orbit-z
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · cha9ro
Params8.03B
Context128K
Smallest4.7 GB
Tool use
ML
mlfoundations dev oh v3 1 only glaive code assistant
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding

Keep browsing