GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo camel math gpt 4o mini
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CE
nothingiisreal/L3.1-8B-Celeste-V1.5
Celeste · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TR
Triangulum v2 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B GRA Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
AXCXEPT Llama 3.1 8B EZO 1.1 it
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
WR
Wraith 8b Heretic
Wraith · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Llama 3.1 8B Ko 4oDistil Heresy DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PN
L3 Pneuma 8B i1
Pneuma · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DC
oh dcft v1.2 no curation no airoboros gpt 4o mini
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Amelia CD 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3.1 8B Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B GRA Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PR
Primal Mini 3B Exp
Primal · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Llama 3.1 8B EZO 1.1 it
Llama · MCZK
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 1 ox llms 8b sft only germany data
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llamaverse 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B abliterated i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Leonida Beta 2
Llama · jgchaparro
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
athirdpath Llama 3.1 Techne RP 8b v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LU
Lumimaid v0.2 8B
Lumimaid · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 Elm Turbo 3B Instruct
Llama · mradermacher
Params3.11B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Impish_LLAMA_3B_Abliterated
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Models Deepcogito Cogito v1 Preview Llama 70B
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama-Guard-3-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo share gpt
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Models Ilsp Llama Krikri 8B Instruct
Llama · MaziyarPanahi
Params8.2B
Context128K
Smallest5.7 GB
Tool use
LL
Llama 3.1 8B GRA WizardLM
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh teknium scaling down random 0.4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing