GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Instruct
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 3.1 8b offensive joker
Llama · Elgyn90
Params8.03B
Context128K
Smallest6.6 GB
GGUF
ML
mlfoundations dev OH original wo glaive code assistant
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
RY
RyanYr reward judge SFT genRM pilot exp
Ryanyr · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MO
Dava84/Mod2
Mod · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
barc0 transduction run10 20k seed100 gpt4omini instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AS
Aspire V4 8B Model Stock
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TU
tulu v.3.9 v0
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · forkjoin-ai
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AS
Aspire V2 ALT 8B Model Stock
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
oh dcft v3.1 llama 3.3 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
simpo oh dcft v3.1 llama 3.1 405b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · codegood
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ablation 40 rafathenev2.cmrmix.masked shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoning
HE
Hermes
Hermes · lefantom00
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · steampunque
Params8.03B
Context128K
Smallest5.1 GB
Tool use
LL
Llama 3.1 8b DeepDive 3 Prev v1.0 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · EShawC
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · SentientAGI
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
ST
stackexchange vegetarianism
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 ARC Heavy Transduction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo camel chemistry
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
nbeerbower/Llama-3.1-Saoirse-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
ablation 52 rafathenev2.0.8.0 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SP
Sparse_Ft_En_Sw
Sparse · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh v1 w v3 slim orca 500k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing