GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
MF
MFANNv0.22.1 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 Tulu 3 8B abliterated Q8 0
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 Carballo
Llama · pablo-rf
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 6529 tuned Q8 0
Llama · brookr
Params8.03B
Context128K
Smallest8.5 GB
LL
llama gRPo emotions nothoughts
Llama · Heralax
Params7.24B
Context32K
Smallest7.7 GB
LL
shisa v2 llama3.1 405b i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · jinmrong
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B KG Extraction v2
Llama · n9102125
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
ST
stackexchange codegolf
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1. 8b Instruct
Llama · divyanshusingh
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · hope-hui
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Kaan35
Params8.03B
Context128K
Smallest5.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · jacky840327
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Trisert
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama Guard 3 8B
Llama · GuardwallAI
Params8.03B
Context128K
Smallest8.5 GB
ME
mellow mate 8b i1
Mellow · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · jdumanski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B IQ3 XXS
Llama · performanceoptician
Params8.03B
Context128K
Smallest3.3 GB
UN
oh v1.3 unnatural instructions x8
Unnatural · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Smallest8.5 GB
TR
Training
Training · 4rduino
Params42M
Context—
Smallest0.2 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · RichardErkhov
Params70.6B
Context128K
Smallest26.4 GB
LL
ablation 42 rafathenev2.cmrmixen.masked shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
LL
Huihui ai_Llama 3_1 Nemotron 51B Instruct Abliterated
Llama · NexesQuants
Params51.5B
Context128K
Smallest54.7 GB
LL
Pretrain_Llama
Llama · DreamTree
Params8.03B
Context128K
Smallest8.5 GB
LL
Ft Counsel Meta Llama 3.1 8B Instruct Regular Full
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · 5fp
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · stajerc
Params8.03B
Context128K
Smallest5.7 GB