GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.3 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 EstLLM 8B 0525
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NA
NarrowMaid 8B
Narrowmaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nvidia.OpenMath2 Llama3.1 70B
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Supernova Lite Instruct Merge Abliterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
teknium/Llama-3.1-AlternateTokenizer
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · hakks660
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Orenguteng Llama 3.1 8B Lexi Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
deepthought 8b llama v0.01 alpha
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
TO
ToM PBM 8B
Tom · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia ET 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MU
Multiclass Think RM 8B
Multiclass · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Eurdem/Defne-llama3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 MedIT SUN 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
SAO LightMix 8B Model Stock i1
Sao · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SH
Test_3AD80
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DC
oh dcft v1.3 no curation gpt 4o mini scale 8x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Nephilim Metamorphosis v1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct DASHQ Q2
Llama · jkim96
Params8.03B
Context128K
Smallest2.5 GB
LL
Llama PLLuM 8B Instruct 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ZE
ZEUS 8B V2
Zeus · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 w v3 camel chemistry gpt 4o mini
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta 405b instruct cpu optimized
Llama · nisten
Params410B
Context128K
Smallest169.0 GB
LL
Llama 3.1 8b DoberWild v2.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3 70B IT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 8B Fireplace2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
EV
EvoNet 8b Reasoning
Evonet · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB