GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama3.1 sql
Llama · t3h2
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
Llama3.1 DeluxeTrifecta 8B
Llama · Stormtrooperaim
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 DeluxeTrifecta 8B
Llama · Stormtrooperaim
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · paultimothymooney
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MF
MFANNv0.24 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Llama 3.1 8B
Llama · andquant
Params8.03B
Context128K
Smallest4.7 GB
GGUF
SE
seesaw
Seesaw · DannySon
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama31 nckulib
Llama · lib65771
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mani-nm
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · eric-musa
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
MFANNv0.22 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · pcuenq
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · pytholic
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llama 3.1 8B Merge LoRA
Llama · MSI-AI-Group
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 3.1 alpaca ni
Llama · ddenes
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · jin1998
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.x 70b Tess Dolphin 128K v1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.1 Carballo
Llama · gamallo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 8b lora uncensored thinking F16
Llama · Mote1001
Params21M
Context—
Smallest0.1 GB
GGUF
LL
llama 3.1 8b alpaca finetune
Llama · CalmThinker
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 airoboros x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
llama3.1 8b customer support
Llama · oldradio2511
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
deepthought 8b llama v0.01 alpha Q4 K M
Llama · waltervix
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dorna2 Llama3.1 8B Instruct
Llama · irmma
Params8.03B
Context128K
Smallest4.4 GB
GGUF
TE
test
Test · XOLODILNIK
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
hotep kush v4
Llama · hotepfederales
Params8.03B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
GE
google gemma Hectron4 31B it
Gemma · hectorruiz9
Params31B
Context—
Smallest0.0 GB
GGUF
LL
ablation 50 mathcode shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 8b
Llama · elichen3051
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · wk1
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing