GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
OpenMath2 Llama3.1 8B Q4 0
Llama · zsolx2
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 MedIT SUN 8B Q4 K M
Llama · Aashraf995
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
EfficientMath AI
Llama · iamabhayaditya
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLAMA3.1 CHATBOT 02
Llama · jott1970
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Stefan
Llama · l3dz3pp
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLaMA Mesh
Llama · X054848
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 138 Shisav2.Gbs128.1.6E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3.1 8B Instruct
Llama · Ayylex
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
6yuru99 Llama3.1 CommonDiseaseClassification
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 10 raathenev2 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SW
KaraKaraWitch/L3.1-70b-Swallow-Saigetsu
Swallow · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SW
Sweetened Condensed Milk 8B Model Stock
Sweetened · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Selene 1 Mini Llama 3.1 8B Q6 K
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · dasChronos1
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · CodingToni
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
HermesNova Llama 3.1 8B
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TR
translater
Translater · L-and
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ST
stackexchange graphicdesign
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q6 K
Llama · roleplaiapp
Params70.6B
Context128K
Smallest57.9 GB
CodingRoleplayTool use
NY
NyayaLLM
Nyayallm · ncncomplete
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperSwallow 70B Instruct v0.1
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
GGUF
LL
ablation 55 rafathenev2.rp.tl shisa v2 llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 Swallow 8B v0.1 Q4 K M
Llama · aashish1904
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · Lumia101
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
nvidia Llama 3.1 Nemotron 70B Instruct bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
CK
ckoozzzu/d2
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B SmileyLlama 1.1 Mpro
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · Uynaity
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing