GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
JailBreakLLM
Llama · RaselAntor
Params8.03B
Context128K
Smallest8.5 GB
Tool use
RE
RexDrug Base
Rexdrug · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Ablation 163 Shisav2.If50 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama3.1 8b
Llama · afg1
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
unsloth Reflection Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev oh v1.3 opengpt x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct GTAP v3 Q4 K M
Llama · DuoNeural
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
LL
Meta Llama 3.1 8B Instruct
Llama · reach-vb
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Apollo 0.4 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · DevQuasar-4
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HE
Hermes 3 iSMART
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dolphin 3.0 Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 8b DoberWild v2.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
PESTO llama base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mlfoundations dev llama3 1 8b oh v3.1 wo slim orca 550k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 SuperHawk 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ML
mlfoundations dev oh v1.3 metamath x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Jamet 8B MK.I
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B ArtTherapy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
expertai/SLIMER-PARALLEL-LLaMA3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b Dolermed V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 8B Base 250801
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TU
8B Tulu full
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b baseline dcft oh v3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Poro 2 70B Base
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Coding
LL
llama 3.1 Asian Bllossom 8B Translator
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Latxa Llama 3.1 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use

Keep browsing