GGUF models: llama3.1 license
3570 GGUF models listed under the llama3.1 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 410B parameters. The longest trained context is 4192K tokens.
LL
Llama PLLuM 70B Instruct 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama PLLuM 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mlfoundations dev hp ablations llama3 epoch5 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Kawaiides llama3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Instruct.immunized.v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b DoberWild v2.01 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
stackexchange health
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
allenai.Llama 3.1 Tulu 3.1 8B
Llama · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3_1 8B Instruct AMD Python
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B SmileyLlama 1.1 Mpro
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
DongfuJiang prm gsm 2k with full sol mix ref redistribution hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
NO
mlfoundations dev oh v3 1 only dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated Sabresooth
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
WA
WangchanLION v3 IT
Wangchanlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
MagpieLM 8B SFT v0.1
Magpielm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LW
LwQ 30B Instruct
Lwq · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
NO
mlfoundations dev OH DCFT V3 wo dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 camel biology x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · bullerwins
Params70.6B
Context8K
Q4_K_M42.5 GB
GL
L3.1 70b glitz v0.2
Glitz · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
FI
xkbang/FineLlama-3.1-8B
Finellama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 EstLLM 70B Instruct 0826
Llama · Dr-sdr
Params70.6B
Context128K
Smallest42.5 GB
RE
ref 70 e3 i1
Ref · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B ArliAI Indo Formax v1.0
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 1 8b mlfoundations dev stackexchange sports i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
ref 70 e3
Ref · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB