GGUF models: llama3.1 license

3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama PLLuM 70B Instruct 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama PLLuM 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev hp ablations llama3 epoch5 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Kawaiides llama3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 8B Instruct.immunized.v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8b DoberWild v2.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
stackexchange health
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
allenai.Llama 3.1 Tulu 3.1 8B
Llama · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3_1 8B Instruct AMD Python
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Tulu 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B SmileyLlama 1.1 Mpro
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DO
DongfuJiang prm gsm 2k with full sol mix ref redistribution hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NO
mlfoundations dev oh v3 1 only dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated Sabresooth
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WA
WangchanLION v3 IT
Wangchanlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MA
MagpieLM 8B SFT v0.1
Magpielm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LW
LwQ 30B Instruct
Lwq · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
NO
mlfoundations dev OH DCFT V3 wo dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · bullerwins
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GL
L3.1 70b glitz v0.2
Glitz · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
FI
xkbang/FineLlama-3.1-8B
Finellama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 EstLLM 70B Instruct 0826
Llama · Dr-sdr
Params70.6B
Context128K
Smallest42.5 GB
Tool use
RE
ref 70 e3 i1
Ref · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3 1 8b mlfoundations dev stackexchange sports i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
ref 70 e3
Ref · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing