GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
PsychoCounsel Llama3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Frantic66
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
unsloth/Meta-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
simonycl llama 3.1 8b instruct ultrafeedback single judge
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SauerHuatuoSkyworkDeepWatt O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 Q4 K M
Llama · NeuraFusionAI
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 175 Finalsft2 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Typhoon v1.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B PlumCode
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange hinduism
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B bnb 4bit M exec roles
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 camel biology x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · NexesQuants
Params8.03B
Context128K
Smallest3.7 GB
VA
VaryTales 8b
Varytales · Gurubot
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Models Meta Llama Meta Llama 3.1 8B Instruct
Llama · yuvira121
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 8b spaetzle v51
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
NA
NarrowMaid 8B
Narrowmaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Dolerstormed V1.04
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Bel KI v1
Bel · Beko2210
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange linguistics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
hiligaynon llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8b Smarteaz V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HI
Models Hibernates Hiber Multi 10B Instruct
Hiber · MaziyarPanahi
Params10.7B
Context4K
Smallest7.4 GB
LL
nbeerbower/llama3.1-kartoffeldes-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Deepcogito.Cogito v2 Preview Llama 70B
Llama · DevQuasar
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B LucyV2 1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 typhoon2 8b instruct Q4 K M
Llama · CT-Ati
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Aspire V2 8B Model Stock
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB