GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Ft Counsel Meta Llama 3.1 8B Instruct Jepa
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange gamedev
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
100 1eb Pag Llama 3.1
Llama · KiruuPixel
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · wolflycanorcant
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q4 0
Llama · roleplaiapp
Params70.6B
Context128K
Smallest40.0 GB
CodingRoleplayTool use
AT
athena base
Athena · quartzort
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 8B Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · qskxx
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama patentLLMClaimsSmall
Llama · miketeod
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ML
mlfoundations dev oh v1.3 evol instruct x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q3 K L
Llama · roleplaiapp
Params70.6B
Context128K
Smallest37.1 GB
CodingRoleplayTool use
LL
Llama 3.1 Amelia MTMERGED 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
German RAG LLAMA 3.1 8B SFT HESSIAN AI Q8 0
Llama · avemio
Params8.03B
Context128K
Smallest8.5 GB
Reasoning
AS
Aspire V4 ALT 8B Model Stock i1
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Swallow 8B v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Ablation 108 Cpt.Rptext Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Ft Counsel Meta Llama 3.1 8B Instruct Regular Dom2
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ft Counsel Meta Llama 3.1 8B Instruct Jepa Full
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · adrlau
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF Q3 K M
Llama · roleplaiapp
Params70.6B
Context128K
Smallest34.3 GB
CodingRoleplayTool use
LL
ablation 44 rewild.rafathenev2 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 anime llm
Llama · xinaijibu293
Params8.03B
Context128K
Smallest4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · jeremierostan
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.1 ARC Potpourri Transduction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CodingTool use
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo opengpt
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
HermesNova Llama 3.1 8B Q4 K M
Llama · TheDrunkenSnail
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · TheCoffeeMagistrate
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Szabi Llama v7
Llama · jabba77
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama Open Finance 8B
Llama · Srijan-Chakraborty
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Allenai Llama 3.1 Tulu 3 70B
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
GGUF

Keep browsing