GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Reasoning Llama 3.1 CoT RE1 i1 Q2 K
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
LL
Hercules 6.1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 0x mini Q2 K
Llama · ozone-research
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
deepthought 8b llama v0.01 alpha Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Magpie Align Llama 3.1 8B Magpie Align SFT v0.2
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Reasoning
LL
Llama 3.1 8B Instruct
Llama · mkenfenheuer
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ablation 17 rafbestmixnoshuffle shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
GGUF
HI
Hiber Multi 10B Instruct
Hiber · itlwas
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K S
Llama · AlexeyL
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
ablation 19 rafbestseqshuffle shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Otakadelic
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Natsumura Assistant 1.0 Llama 3.1 8b
Llama · tohur
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · lactroiii
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
llama3.1 quantization
Llama · helloollel
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
hitachi nlp Llama 3.1 70B FLDx2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Dare Angel 8B
Llama · BornSaint
Params8.03B
Context8K
Smallest4.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · callitaclue
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 8B instruct
Llama · williamtom-3010
Params8.03B
Context128K
Smallest4.9 GB
Tool use
LL
v3ray/Llama-3-1-70B-Instruct-base
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama LIMBA 2.0
Llama · FPll
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 typhoon2 8b Q4 K M
Llama · CT-Ati
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · bbennett17
Params8.03B
Context128K
Smallest5.7 GB
Tool use
MA
MagpieLM 8B SFT v0.1
Magpielm · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
SH
Test_3AD80
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
iLang Llama 8B v2 GGUF Q4
Llama · i-Lang
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct Bnb 4bit
Llama · 100customs
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing