GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
MY
MythoNemo L3.1 70B v1.0
Mythonemo · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DO
DongfuJiang prm version2 subsample no ref hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH original wo evol instruct 70k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Zhengyi.LLaMA Mesh
Llama · DevQuasar-3
Params8.03B
Context128K
Q4_K_M4.9 GB
WI
Wingless Alice RP NSFW 8B
Wingless · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
sparsh35/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ML
mlfoundations dev OH DCFT V3 wo evol instruct 140k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3.1 8B
Llama · mu2solutions
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B MOTH
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DeepDive 3 R1 Prev i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
lordjia/Llama-3.1-Cantonese-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
remember to breathe 8b Model Stock
Remember · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
deval-core/base-eval
Base · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KoBioMed Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only collective cognition
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
DC
oh dcft v1.3 no curation gpt 4o mini scale 0.5x
Dcft · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Spark
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KokoroChat High
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
stackexchange security
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 alpaca x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev alpaca inst gen 4omini resp gen gpt4o shareGPT format
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 camel math x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ablation 137 Shisav2.Gbs128.1.4E5 Shisa v2 Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BR
BrownLoafers 70B
Brownloafers · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 1 70B Instruct Base
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8b DoberWild v2.02 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oh dcft v3.1 llama 3.3 70b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
prithivMLmods.Megatron Opus 14B 2.0
Megatron · DevQuasar-2
Params14.7B
Context16K
Q4_K_M8.9 GB