GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama3.1 SuperNovaLite HuatuoSkywork O1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down random 0.2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Theia Llama 3.1 8B v1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Gemma 2 27b ORPO iter3 i1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
ML
mlfoundations dev oh v1.3 alpaca x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Locutusque/Apollo-0.4-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · GPT4All-Community
Params8.03B
Context128K
Smallest5.3 GB
LL
Llama 3.1 8B GRA Condor
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
deepthought 8b llama v0.01 alpha
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B ArliAI RPMax v1.2
Llama · OwenArli
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
stackexchange pets
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 opengpt x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Huihui ai.Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · DevQuasar-8
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 camel chemistry x8
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange music
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V7
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V22
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
II Tulu 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepthought 8b abliterated
Deepthought · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 46 rafathenev2.rp shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
TitanForge 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only gpteacher
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama O 3.1 8B levent
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Locutusque/Hercules-6.1-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MY
MythoNemo L3.1 70B v1.0 i1
Mythonemo · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 camel math x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama capro
Llama · teclabs
Params8.03B
Context128K
Q4_K_M4.9 GB