GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B
Llama · Ak1104
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Open Finance 8B
Llama · enfantdupeuple
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · psychopenguin
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
BRAG Llama 3.1 8b v0.1 Q4 0
Llama · AnuAna14
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama_8B_Lima_10
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Reasoning Llama 3.1 CoT RE1 f16
Llama · roleplaiapp
Params8.03B
Context128K
Smallest16.1 GB
ReasoningTool use
XK
xkbang FineLlama 3.1 8B
Xkbang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Sumail
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Llama Guard 3 8B
Llama · venkatsriram
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
solus v1 llama 3.1 8b instruct q4
Llama · Fazmin
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · Ren6767
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · pingzhou
Params8.03B
Context128K
Smallest4.0 GB
Tool use
LL
deepthought 8b llama v0.01 alpha Q8 0
Llama · wmichael
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Hansoldeco Llama 3.1 8b It v0.2
Llama · sosoai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3.1-8B-Instruct
Llama · alamios
Params8.03B
Context128K
Smallest16.1 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Dorna2 Llama3.1 8B Instruct
Llama · aeranginkaman
Params8.03B
Context128K
Smallest4.0 GB
GGUF
LL
KONI Llama3.1 8B Instruct 20241024
Llama · suminimini
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MF
MFANNv0.24 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · flyfishstudio
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llamaverse 3.1 8B Instruct Q5 K M
Llama · sethuiyer
Params8.03B
Context8K
Smallest5.7 GB
GGUF
SN
Snowball
Snowball · B34st
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama3.1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b DodoWild v2.02 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3.1 8b manumit v1
Llama · yethdev
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 70B EZO 1.1 It
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B
Llama · gnigguhface
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
biyoloji llama 3.1 8b
Llama · nyzmemre
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 39 cmrmix.masked shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoning
ST
stackexchange devops
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing