GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama 3.1 8B Instruct
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 8b offensive joker
Llama · Elgyn90
Params8.03B
Context128K
Smallest6.6 GB
ML
mlfoundations dev OH original wo glaive code assistant
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
RY
RyanYr reward judge SFT genRM pilot exp
Ryanyr · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
MO
Dava84/Mod2
Mod · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
barc0 transduction run10 20k seed100 gpt4omini instruct fft lr1e 5 epoch2
Barc · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Aspire V4 8B Model Stock
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
tulu v.3.9 v0
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · forkjoin-ai
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Aspire V2 ALT 8B Model Stock
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.3 70b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
simpo oh dcft v3.1 llama 3.1 405b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · codegood
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ablation 40 rafathenev2.cmrmix.masked shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
Hermes
Hermes · lefantom00
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama 3.1 8B Instruct
Llama · steampunque
Params8.03B
Context128K
Smallest5.1 GB
LL
Llama 3.1 8b DeepDive 3 Prev v1.0 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · EShawC
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · SentientAGI
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange vegetarianism
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 ARC Heavy Transduction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo camel chemistry
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nbeerbower/Llama-3.1-Saoirse-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
ablation 52 rafathenev2.0.8.0 shisa v2 llama 3.1 8b lr8e6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
New_Wiki_Model
New · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SP
Sparse_Ft_En_Sw
Sparse · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1 w v3 slim orca 500k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB