GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Ablation 164 Shisav2.If100 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8B Instruct
Llama · Bhuvneesh
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · ddarolf
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · redarmee
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Amelia ET 8B v1
Llama · brunoyun
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct.Q4 0
Llama · gbueno86
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · rnd7
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest4.0 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · Open4bits
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · kowlick
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · dungnasa
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · BitStreamX
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
ablation 20 rafbestseq.1epoch shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · Jianping746
Params8.03B
Context128K
Smallest4.4 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
NE
NeuralDaredevil SuperNova Lite 7B DARETIES abliterated
Neuraldaredevil · BoltMonkey
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 8B quantization
Llama · logiya-vidhyapathi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · matfyzacek
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · skoppisetti
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · CaioXapelaum
Params8.03B
Context128K
Smallest5.7 GB
Reasoning
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Meta Llama 3.1 70B
Llama · Ffftdtd5dtft
Params70.6B
Context128K
Smallest26.4 GB
GGUF
LL
Selene 1 Mini Llama 3.1 8B IQ4 XS
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.4 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · viniciusianni
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
Deval Core Base Eval
Base · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct HF Q8 0
Llama · roleplaiapp
Params70.6B
Context128K
Smallest75.0 GB
CodingRoleplayTool use
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Ablation 101 Bestofn.Atlo.Rp.Tlx25 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · flyfishstudio
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Meta Llama 3.1 8B SurviveV3 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF

Keep browsing