GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · mradermacher
Params4.17B
Context128K
Q4_K_M2.6 GB
GGUF
LL
Llama 3.1 ARC Potpourri Induction 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Natsumura Storytelling Rp 1.0 Llama 3.1 8b
Llama · tohur
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
allenai.Llama 3.1 Tulu 3 8B
Llama · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange proofassistants
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Models Mlx Community Meta Llama 3.1 8B Instruct Bf16
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
ML
mlfoundations dev webinstruct v1 beta stage 3 shareGPT format
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meta-llama/Llama-3.1-8B-Instruct
Llama · ISTA-DASLab
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
ORANSight LLama 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
BanglaLLama 3.1 8b unolp culturax base v0.0.1
Banglallama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WR
Wraith 8b
Wraith · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
BR
Brisk Evolution 12B v0.1
Brisk · mradermacher
Params12B
Context4192K
Q4_K_M7.3 GB
Roleplay
GE
Geobot
Geobot · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Fireplace2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TR
Triangulum 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Reasoning
LL
Viper Llama31 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · pek111
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
unsloth/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Wazuh Llama 3.1 8b Assistant
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama SEA LION v3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo unnatural instructions
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Turkish
Llama · mradermacher
Params8.1B
Context128K
Q4_K_M5.0 GB
GGUF
LL
LLaMA Mesh
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Hermedive V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v3 1 only evol instruct 70k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B FlashNorm
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing