GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Abliterated Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
BatsResearch Llama 3.1 8B bonito v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instuct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MA
MagpieLM 8B Chat v0.1
Magpielm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta llama_Meta Llama 3.1 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v3 70B IT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 Tulu 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Theia Llama 3.1 8B v1
Llama · Chainbase-Labs
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Base 250801
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AS
Assistant_Pepe_8B
Assistant · bartowski
Params8.04B
Context1048K
Q4_K_M4.9 GB
GGUF
GG
GGUFDumps
Ggufdumps · koboldcpp
Params20.1B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin3.0 Llama3.1 8B Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3.1-8B-bnb-4bit
Llama · chatpdflocal
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
shisa-v2-llama3.1-8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
Cathallama 70B
Cathallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Instruct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev stackoverflow 10000tasks 0p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Cogito v1 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
FinR1 Llama 8b Multi Language Thinking
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
LLaMA 3.1 Turkis 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
Cathallama 70B
Cathallama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AS
AstroSage 70B
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B Magpie Align v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Unhinged Vision 8B
Llama · FiditeNemini
Params8.03B
Context8K
Smallest8.5 GB
Vision
LL
Sparse Llama 3.1 8B 2of4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing