GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
ML
mlfoundations dev oh teknium scaling down random 0.7
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
Triangulum 10B
Triangulum · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Llama-3.1-8B-Instruct
Llama · beyond-logic-labs
Params8.03B
Context128K
Smallest7.3 GB
CE
L3.1 70B Celeste V0.1 BF16
Celeste · leafspark
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B
Llama · kjaedhrbgo
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
IN
inter play sim assistant test
Inter · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AI
AIbot
Aibot · ishahbku
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8b Instruct
Llama · doaonduty
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · 1bit-MONSTER
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V30
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Krikri 8B Instruct
Llama · zontos
Params8.2B
Context128K
Smallest5.9 GB
LL
Llama 3.1 8b DodoWild v2.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PR
prm version2 subsample hf
Prm · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · dotsnangles
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Iambackup
Params8.03B
Context128K
Smallest6.6 GB
LL
Meta Llama 3.1 8B Instruct
Llama · hamminson
Params8.03B
Context128K
Smallest3.7 GB
LL
Huihui ai_Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ML
mlfoundations dev oh v1.3 alpaca x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
LL
Latxa Llama 3.1 70B Instruct
Llama · itzune
Params70.6B
Context128K
Smallest75.0 GB
LL
Llama 3.1 Storm 8B
Llama · Solshine
Params8.03B
Context128K
Smallest3.2 GB
LL
Reasoning Llama 3.1 CoT RE1 Q3 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
LL
ilocano llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.x 70b Dolphineva 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70B LatamGPT SFT 1.0
Llama · pabloreyespo
Params70.6B
Context4K
Q4_K_M42.5 GB
LL
hyemijo omed llama3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama sahabat AI v2 70B GGUF Relist
Llama · blackshell69
Params70.6B
Context128K
Smallest24.5 GB
LL
MFANN llama3.1 abliterated SLERP v3.1 Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta-Llama-3.1-8B-Instruct
Llama · nihaomur
Params8.03B
Context128K
Smallest5.7 GB