GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama3.1 Elm Turbo 4B Instruct
Llama · mradermacher
Params4.17B
Context128K
Q4_K_M2.6 GB
LL
Llama 3.1 ARC Potpourri Induction 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Natsumura Storytelling Rp 1.0 Llama 3.1 8b
Llama · tohur
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
allenai.Llama 3.1 Tulu 3 8B
Llama · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange proofassistants
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models Mlx Community Meta Llama 3.1 8B Instruct Bf16
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ML
mlfoundations dev webinstruct v1 beta stage 3 shareGPT format
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta-llama/Llama-3.1-8B-Instruct
Llama · ISTA-DASLab
Params8.03B
Context128K
Smallest3.2 GB
LL
ORANSight LLama 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
BanglaLLama 3.1 8b unolp culturax base v0.0.1
Banglallama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
WR
Wraith 8b
Wraith · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BR
Brisk Evolution 12B v0.1
Brisk · mradermacher
Params12B
Context4192K
Q4_K_M7.3 GB
GE
Geobot
Geobot · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Fireplace2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
Triangulum 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Viper Llama31 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · pek111
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
unsloth/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Wazuh Llama 3.1 8b Assistant
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo unnatural instructions
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Turkish
Llama · mradermacher
Params8.1B
Context128K
Q4_K_M5.0 GB
LL
LLaMA Mesh
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Hermedive V1.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only evol instruct 70k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B FlashNorm
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB