GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
llama3.1 sql
Llama · t3h2
Params3.21B
Context128K
Smallest3.4 GB
LL
Llama3.1 DeluxeTrifecta 8B
Llama · Stormtrooperaim
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 DeluxeTrifecta 8B
Llama · Stormtrooperaim
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · paultimothymooney
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.24 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama 3.1 8B
Llama · andquant
Params8.03B
Context128K
Smallest4.7 GB
SE
seesaw
Seesaw · DannySon
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama31 nckulib
Llama · lib65771
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mani-nm
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · eric-musa
Params8.03B
Context128K
Smallest4.7 GB
LL
MFANNv0.22 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · pcuenq
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · pytholic
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B Merge LoRA
Llama · MSI-AI-Group
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 alpaca ni
Llama · ddenes
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · jin1998
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.x 70b Tess Dolphin 128K v1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 Carballo
Llama · gamallo
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 8b lora uncensored thinking F16
Llama · Mote1001
Params21M
Context—
Smallest0.1 GB
LL
llama 3.1 8b alpaca finetune
Llama · CalmThinker
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 airoboros x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
LL
llama3.1 8b customer support
Llama · oldradio2511
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
deepthought 8b llama v0.01 alpha Q4 K M
Llama · waltervix
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dorna2 Llama3.1 8B Instruct
Llama · irmma
Params8.03B
Context128K
Smallest4.4 GB
TE
test
Test · XOLODILNIK
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
hotep kush v4
Llama · hotepfederales
Params8.03B
Context128K
Q4_K_M5.0 GB
GE
google gemma Hectron4 31B it
Gemma · hectorruiz9
Params31B
Context—
Smallest0.0 GB
LL
ablation 50 mathcode shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b
Llama · elichen3051
Params8.03B
Context128K
Smallest16.1 GB
LL
Meta Llama 3.1 8B Instruct
Llama · wk1
Params8.03B
Context128K
Q4_K_M4.9 GB