Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama-3-SOVL-MopeyMule-Blackroot-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ArrowCanaria Llama 8B SFT v0.1
Llama · mmnga-o
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
hermes llama3 roleplay 1000 v8 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Unhinged Vision 8B
Llama · YuujiLab
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Orpo v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-aaditya-OpenBioLLM-Blackroot-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 ELYZA JP 8B Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama Guard 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.2 3B f32
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · steampunque
Params108B
Context10240K
Smallest42.8 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · Andycurrent
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
HarmBench Llama 2 13b Cls
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
llama-3-neural-chat-v1-8b
Llama · nitsuai
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-xLAM-2-8b-fc-r
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B DPO
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
FlexGuard LLaMA3.1 Instruct 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Genius Llama3.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA3 8B 8bit DepressionDetection Reddit
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 3 8b English to Hinglish
Llama · Hinglish-Project
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama2 70b chat uncensored
Llama · YokaiKoibito
Params69B
Context2K
Q4_K_M41.4 GB
LL
Kudzu-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B blueVi
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Qwen1.5 72B Chat LLaMAfied
Llama · mradermacher
Params72.3B
Context32K
Q4_K_M45.2 GB
LL
LLama 3.1 8B HyperNova
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
calme-2.2-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Ollama Video llama 7B
Llama · ManishThota
Params6.74B
Context4K
Smallest13.5 GB
LL
Vegybin11 Llama 3.1 8B bnb 4bit python
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.2 1B physics finetuned
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama-3-Deppressed-Therapist-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB