GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
PsychoCounsel Llama3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Frantic66
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
unsloth/Meta-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
simonycl llama 3.1 8b instruct ultrafeedback single judge
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
SauerHuatuoSkyworkDeepWatt O1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 Q4 K M
Llama · NeuraFusionAI
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ablation 175 Finalsft2 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8b Typhoon v1.03
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B PlumCode
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange hinduism
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B bnb 4bit M exec roles
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · NexesQuants
Params8.03B
Context128K
Smallest3.7 GB
GGUF
VA
VaryTales 8b
Varytales · Gurubot
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 8B Instruct
Llama · yuvira121
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 8b spaetzle v51
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NA
NarrowMaid 8B
Narrowmaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8b Dolerstormed V1.04
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BE
Bel KI v1
Bel · Beko2210
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange linguistics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
hiligaynon llama 3.1 FT 8B
Llama · PLTAT
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8b Smarteaz V1.01
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HI
Models Hibernates Hiber Multi 10B Instruct
Hiber · MaziyarPanahi
Params10.7B
Context4K
Smallest7.4 GB
GGUF
LL
nbeerbower/llama3.1-kartoffeldes-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Deepcogito.Cogito v2 Preview Llama 70B
Llama · DevQuasar
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Meta Llama 3.1 8B LucyV2 1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 typhoon2 8b instruct Q4 K M
Llama · CT-Ati
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AS
Aspire V2 8B Model Stock
Aspire · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing