GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
ML
mlfoundations dev oh teknium scaling down random 0.7
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TR
Triangulum 10B
Triangulum · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
Reasoning
LL
Llama-3.1-8B-Instruct
Llama · beyond-logic-labs
Params8.03B
Context128K
Smallest7.3 GB
Tool use
CE
L3.1 70B Celeste V0.1 BF16
Celeste · leafspark
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
Meta Llama 3.1 8B
Llama · kjaedhrbgo
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
IN
inter play sim assistant test
Inter · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AI
AIbot
Aibot · ishahbku
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8b Instruct
Llama · doaonduty
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · 1bit-MONSTER
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ZE
ZEUS 8B V30
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Krikri 8B Instruct
Llama · zontos
Params8.2B
Context128K
Smallest5.9 GB
Tool use
LL
Llama 3.1 8b DodoWild v2.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PR
prm version2 subsample hf
Prm · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · dotsnangles
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Iambackup
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · hamminson
Params8.03B
Context128K
Smallest3.7 GB
Tool use
LL
Huihui ai_Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Reasoning
ML
mlfoundations dev oh v1.3 alpaca x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Latxa Llama 3.1 70B Instruct
Llama · itzune
Params70.6B
Context128K
Smallest75.0 GB
Tool use
LL
Llama 3.1 Storm 8B
Llama · Solshine
Params8.03B
Context128K
Smallest3.2 GB
Reasoning
LL
Reasoning Llama 3.1 CoT RE1 Q3 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
ReasoningTool use
LL
ilocano llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.x 70b Dolphineva 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.1 70B LatamGPT SFT 1.0
Llama · pabloreyespo
Params70.6B
Context4K
Q4_K_M42.5 GB
GGUF
LL
hyemijo omed llama3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama sahabat AI v2 70B GGUF Relist
Llama · blackshell69
Params70.6B
Context128K
Smallest24.5 GB
GGUF
LL
MFANN llama3.1 abliterated SLERP v3.1 Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta-Llama-3.1-8B-Instruct
Llama · nihaomur
Params8.03B
Context128K
Smallest5.7 GB
GGUF

Keep browsing