GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
stackexchange chess
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo metamath
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct banking77
Llama · Jorbaty
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
KONI Llama3.1 70B Instruct 20241115
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ML
mlfoundations dev oh v1.3 slim orca x.125
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Chat 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama PLLuM 70B Chat 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo unnatural instructions
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated ICONN 1 BasicChat
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1_OpenScholar 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball R1.1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Nafha Llama3.1 8B Perfumery Expert v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Capro
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
omed llama3.1 8b i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only metamath 40k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
BioMed R1 32B
Biomed · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
LL
mlfoundations dev llama3 1 8b dcft it
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA Mesh
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
jbjeong91 llama3.1 cpo full 0911
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
FI
Fino1 8B Uncensored DeLMAT i1
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama SEA LION v3.5 8B R
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
LLAMA 3_8B_Unaligned_BETA
Llama · mradermacher
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
TA
TableLLM 8b
Tablellm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoningTool use
LL
SillyTilly/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Models Deepcogito Cogito v1 Preview Llama 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Apollo 0.4 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
oxford llms llama3 1 ox llms 8b sft only surveys
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Saoirse 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing