GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
OpenMath2 Llama3.1 8B Q4 0
Llama · zsolx2
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 Storm 8B
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 MedIT SUN 8B Q4 K M
Llama · Aashraf995
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
EfficientMath AI
Llama · iamabhayaditya
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLAMA3.1 CHATBOT 02
Llama · jott1970
Params8.03B
Context128K
Smallest6.6 GB
LL
Stefan
Llama · l3dz3pp
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA Mesh
Llama · X054848
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 138 Shisav2.Gbs128.1.6E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Ayylex
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
6yuru99 Llama3.1 CommonDiseaseClassification
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 10 raathenev2 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SW
KaraKaraWitch/L3.1-70b-Swallow-Saigetsu
Swallow · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
SW
Sweetened Condensed Milk 8B Model Stock
Sweetened · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Selene 1 Mini Llama 3.1 8B Q6 K
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · dasChronos1
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B Instruct
Llama · CodingToni
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
HermesNova Llama 3.1 8B
Llama · DevQuasar
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
translater
Translater · L-and
Params8.03B
Context128K
Smallest8.5 GB
ST
stackexchange graphicdesign
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q6 K
Llama · roleplaiapp
Params70.6B
Context128K
Smallest57.9 GB
NY
NyayaLLM
Nyayallm · ncncomplete
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperSwallow 70B Instruct v0.1
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
ablation 55 rafathenev2.rp.tl shisa v2 llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B v0.1 Q4 K M
Llama · aashish1904
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · Lumia101
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nvidia Llama 3.1 Nemotron 70B Instruct bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
CK
ckoozzzu/d2
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B SmileyLlama 1.1 Mpro
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 8B Instruct
Llama · Uynaity
Params8.03B
Context128K
Q4_K_M4.9 GB