GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
MF
MFANNv0.22.1 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 Tulu 3 8B abliterated Q8 0
Llama · Lucy-in-the-Sky
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 Carballo
Llama · pablo-rf
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 6529 tuned Q8 0
Llama · brookr
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
llama gRPo emotions nothoughts
Llama · Heralax
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
shisa v2 llama3.1 405b i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
GGUF
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · jinmrong
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B KG Extraction v2
Llama · n9102125
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Storm 8B
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Reasoning
ST
stackexchange codegolf
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1. 8b Instruct
Llama · divyanshusingh
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B
Llama · hope-hui
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Kaan35
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · jacky840327
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Trisert
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama Guard 3 8B
Llama · GuardwallAI
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ME
mellow mate 8b i1
Mellow · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · jdumanski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B IQ3 XXS
Llama · performanceoptician
Params8.03B
Context128K
Smallest3.3 GB
GGUF
UN
oh v1.3 unnatural instructions x8
Unnatural · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TR
Training
Training · 4rduino
Params42M
Context—
Smallest0.2 GB
GGUF
LL
Llama 3.1 70B EZO 1.1 It
Llama · RichardErkhov
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LL
ablation 42 rafathenev2.cmrmixen.masked shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoning
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Huihui ai_Llama 3_1 Nemotron 51B Instruct Abliterated
Llama · NexesQuants
Params51.5B
Context128K
Smallest54.7 GB
Tool use
LL
Pretrain_Llama
Llama · DreamTree
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Ft Counsel Meta Llama 3.1 8B Instruct Regular Full
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · 5fp
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · stajerc
Params8.03B
Context128K
Smallest5.7 GB
GGUF

Keep browsing