Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
deepthought 8b llama v0.01 alpha i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Luna AI Llama2 Uncensored
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Llama-3-8B-Instruct_Orce_plus
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-SNAMD-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.2 30B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params30B
Context128K
Q4_K_M18.4 GB
LL
x humor unrestricted
Llama · Galactuuus
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct fictional Chinese v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Scarlett Llama 3 8B v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Jallabi 40B
Llama · mradermacher
Params18.8B
Context4K
Q4_K_M11.3 GB
LL
Ostrich 70B Llama3 251212
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · qwp4w3hyb
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
Llama-3-Mopeyfied-Psychology-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B ImageGen
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.3 8B Thinking Gemini Flash 11000x 128k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-experiment-v1-9B
Llama · RichardErkhov
Params8.9B
Context8K
Q4_K_M5.4 GB
LL
Llama 3.3 8B Instruct Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
gervasio 8b portuguese ptpt decoder
Llama · PORTULAN
Params8.03B
Context128K
Smallest16.1 GB
LL
SLIMER PARALLEL LLaMA3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 JPRP NSFW 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Infinity Instruct 7M 0729 Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Bioinspired Base Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Ultra Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 2 7b chat sexed version2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.3 70B Instruct Heretic v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3.1-8B-Think
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · Abc7347
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Llama3 8b It Prometheus Ko
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB