GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Test_Llama
Llama · DreamTree
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Pramodaic
Params8.03B
Context128K
Q4_K_M4.9 GB
DI
Distilled DarkPlanet Allades 8B
Distilled · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Stormeder v1.04
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · polyverse
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · 5fp
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B
Llama · kaetemi
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Sriexe
Params8.03B
Context128K
Smallest16.1 GB
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · okamototk
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q2 K
Llama · roleplaiapp
Params70.6B
Context128K
Smallest26.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · kolosal
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
PULI LlumiX Llama 3.1
Llama · rewqt435
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · viniciusianni
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · xyottax
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev oh v1.3 metamath x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · annus-lums
Params8.03B
Context128K
Smallest16.1 GB
LL
Meta Llama 3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B Chat Companion
Llama · DarkLegion
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nbeerbower Llama 3.1 Nemotron lorablated 70B bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Meta Llama 3.1 8B
Llama · reach-vb
Params8.03B
Context128K
Smallest8.5 GB
LL
MFANN llama3.1 abliterated SLERP v3.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Viper Llama31 8b
Llama · mx003
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Ffftdtd5dtft
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B
Llama · polyverse
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8b
Llama · YorkieOH10
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B
Llama · shisahni
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · AmpereComputing
Params8.03B
Context128K
Smallest8.1 GB