GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8B
Llama · Plana-Chan
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
MagpieLM 8B Chat v0.1 Q4 K M
Magpielm · ijohn07
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Ckoozzzu New1
New · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MF
MFANNv0.25 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 8B Instruct
Llama · pytholic
Params8.03B
Context128K
Smallest4.7 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · Fredred89
Params8.03B
Context128K
Smallest5.2 GB
LL
Llama 3.1 8B Instuct Uz Q4 K M
Llama · azimjon
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · sgerhart
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · Moha2305
Params8.03B
Context128K
Smallest4.7 GB
LL
hotep kush v3
Llama · hotepfederales
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B Instruct
Llama · Moha2305
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest8.5 GB
LL
BRAG Llama 3.1 8b v0.1 Q4 K M
Llama · VenkatNDivi77
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest6.6 GB
LL
OpenMath2 Llama3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama 3.1 Storm 8B
Llama · Alvant
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B R1 Distill
Llama · justinj92
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama PLLuM 8B Base 2512
Llama · Jerzman
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · e2jhiubyiiyvw
Params8.03B
Context128K
Smallest5.7 GB
LL
Meta Llama 3.1 8B
Llama · vaibhavsatpathy
Params8.03B
Context128K
Smallest4.7 GB
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · wencan-lab
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · Bustion
Params8.03B
Context128K
Smallest8.5 GB
LL
Meta Llama 3.1 8B
Llama · dsouza889
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · Mimi-333
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3 8B Q3 K S
Llama · aswdaegrhjklasdgfhjklasdgfhjkl
Params8.03B
Context128K
Smallest3.7 GB
ML
mlfoundations dev oh v1.3 camel math x2
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
AK
akin yurt finely
Akin · aab20abdullah
Params8.03B
Context128K
Smallest4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 0
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
LL
Llama PRM800K
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8B TXT2JSON FT Q4 K M
Llama · wyzhaoc
Params8.03B
Context128K
Q4_K_M4.9 GB