GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Instruct
Llama · biosharp18
Params8.03B
Context128K
Smallest4.7 GB
Tool use
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo opengpt
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
VA
Valiant Vanta 8B Dark Fusion
Valiant · Stormtrooperaim
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · skarmani
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Dabitron
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Train_Llama
Llama · DreamTree
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
llama 3.1 finetuned alpaca
Llama · brookr
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · jeremierostan
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Selene 1 Mini Llama 3.1 8B Q2 K
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Selene 1 Mini Llama 3.1 8B Q8 0
Llama · roleplaiapp
Params8.03B
Context128K
Smallest8.5 GB
Tool use
IN
L3.1 8b RP Ink Q8 0
Ink · Ransss
Params8.03B
Context128K
Smallest8.5 GB
RoleplayTool use
LL
Llama 3.1 8B Instruct
Llama · pytholic
Params8.03B
Context128K
Smallest16.1 GB
Tool use
LL
Llama 3.1 8B RYS 18 22
Llama · john-broadway
Params8.9B
Context128K
Q4_K_M5.4 GB
ReasoningTool use
LL
Meta Llama 3.1 8B
Llama · magiccpp
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · sawd231
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Seacorn_Llama3.1 8b Reasoning Summarizer_Hf
Llama · seacorn
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
LL
Llama 3.1 8B Instruct
Llama · srhm-ca
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Hansoldeco Llama 3.1 8b It v0.2
Llama · sosoai
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MA
MagpieLM 8B Chat v0.1
Magpielm · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
meta llama Meta Llama 3.1 8B Instruct FP8
Llama · jesse-r-s-hines
Params7M
Context128K
Smallest0.0 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · ornfelt
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Khimari
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · pingzhou
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · davidrpugh
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
MFANNv0.23 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 8b prime kg exp 1
Llama · theseus-research
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · nswetzof
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MA
MADA 8B
Mada · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Exisfar
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing