GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo camel math gpt 4o mini
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
CE
nothingiisreal/L3.1-8B-Celeste-V1.5
Celeste · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
Triangulum v2 10B
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B GRA Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AXCXEPT Llama 3.1 8B EZO 1.1 it
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
WR
Wraith 8b Heretic
Wraith · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Ko 4oDistil Heresy DARE
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PN
L3 Pneuma 8B i1
Pneuma · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DC
oh dcft v1.2 no curation no airoboros gpt 4o mini
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Amelia CD 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3.1 8B Abliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B GRA Alpaca
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PR
Primal Mini 3B Exp
Primal · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · MCZK
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 1 ox llms 8b sft only germany data
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llamaverse 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B abliterated i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Leonida Beta 2
Llama · jgchaparro
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
athirdpath Llama 3.1 Techne RP 8b v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LU
Lumimaid v0.2 8B
Lumimaid · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Elm Turbo 3B Instruct
Llama · mradermacher
Params3.11B
Context128K
Q4_K_M2.0 GB
LL
Impish_LLAMA_3B_Abliterated
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Models Deepcogito Cogito v1 Preview Llama 70B
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-Guard-3-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo share gpt
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models Ilsp Llama Krikri 8B Instruct
Llama · MaziyarPanahi
Params8.2B
Context128K
Smallest5.7 GB
LL
Llama 3.1 8B GRA WizardLM
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down random 0.4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB