GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
JailBreakLLM
Llama · RaselAntor
Params8.03B
Context128K
Smallest8.5 GB
RE
RexDrug Base
Rexdrug · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 163 Shisav2.If50 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b
Llama · afg1
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
unsloth Reflection Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 opengpt x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct GTAP v3 Q4 K M
Llama · DuoNeural
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Meta Llama 3.1 8B Instruct
Llama · reach-vb
Params8.03B
Context128K
Smallest6.6 GB
LL
Apollo 0.4 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · DevQuasar-4
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes 3 iSMART
Hermes · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DoberWild v2.03 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
PESTO llama base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo slim orca 550k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 SuperHawk 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 metamath x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Jamet 8B MK.I
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B ArtTherapy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
expertai/SLIMER-PARALLEL-LLaMA3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Dolermed V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 8B Base 250801
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
8B Tulu full
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b baseline dcft oh v3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Poro 2 70B Base
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
llama 3.1 Asian Bllossom 8B Translator
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Latxa Llama 3.1 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB