GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Reasoning Llama 3.1 CoT RE1 i1 Q2 K
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
LL
Hercules 6.1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 0x mini Q2 K
Llama · ozone-research
Params8.03B
Context128K
Smallest3.2 GB
LL
deepthought 8b llama v0.01 alpha Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
LL
Magpie Align Llama 3.1 8B Magpie Align SFT v0.2
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8B Instruct
Llama · mkenfenheuer
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 17 rafbestmixnoshuffle shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · Nekuromento
Params8.03B
Context128K
Smallest5.7 GB
HI
Hiber Multi 10B Instruct
Hiber · itlwas
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K S
Llama · AlexeyL
Params8.03B
Context128K
Smallest4.7 GB
LL
ablation 19 rafbestseqshuffle shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Otakadelic
Params8.03B
Context128K
Smallest6.6 GB
LL
Natsumura Assistant 1.0 Llama 3.1 8b
Llama · tohur
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · lactroiii
Params8.03B
Context128K
Smallest8.5 GB
LL
llama3.1 quantization
Llama · helloollel
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
hitachi nlp Llama 3.1 70B FLDx2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Dare Angel 8B
Llama · BornSaint
Params8.03B
Context8K
Smallest4.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · callitaclue
Params8.03B
Context128K
Smallest5.6 GB
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 8B instruct
Llama · williamtom-3010
Params8.03B
Context128K
Smallest4.9 GB
LL
v3ray/Llama-3-1-70B-Instruct-base
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama LIMBA 2.0
Llama · FPll
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 typhoon2 8b Q4 K M
Llama · CT-Ati
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · bbennett17
Params8.03B
Context128K
Smallest5.7 GB
MA
MagpieLM 8B SFT v0.1
Magpielm · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SH
Test_3AD80
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
iLang Llama 8B v2 GGUF Q4
Llama · i-Lang
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Bnb 4bit
Llama · 100customs
Params8.03B
Context128K
Q4_K_M4.9 GB