GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
ST
stackexchange chess
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo metamath
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct banking77
Llama · Jorbaty
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KONI Llama3.1 70B Instruct 20241115
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
mlfoundations dev oh v1.3 slim orca x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Chat 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama PLLuM 70B Chat 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo unnatural instructions
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated ICONN 1 BasicChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1_OpenScholar 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball R1.1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Nafha Llama3.1 8B Perfumery Expert v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Capro
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
omed llama3.1 8b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v3 1 only metamath 40k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
BioMed R1 32B
Biomed · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
mlfoundations dev llama3 1 8b dcft it
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA Mesh
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
jbjeong91 llama3.1 cpo full 0911
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
Fino1 8B Uncensored DeLMAT i1
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama SEA LION v3.5 8B R
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · mradermacher
Params8.03B
Context16K
Q4_K_M4.9 GB
TA
TableLLM 8b
Tablellm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SillyTilly/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Models Deepcogito Cogito v1 Preview Llama 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Apollo 0.4 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
oxford llms llama3 1 ox llms 8b sft only surveys
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Saoirse 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB