Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
deepthought 8b llama v0.01 alpha i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Luna AI Llama2 Uncensored
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama-3-8B-Instruct_Orce_plus
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-SNAMD-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Llama3.2 30B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params30B
Context128K
Q4_K_M18.4 GB
RoleplayTool use
LL
x humor unrestricted
Llama · Galactuuus
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct fictional Chinese v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Scarlett Llama 3 8B v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Jallabi 40B
Llama · mradermacher
Params18.8B
Context4K
Q4_K_M11.3 GB
GGUF
LL
Ostrich 70B Llama3 251212
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · qwp4w3hyb
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Mopeyfied-Psychology-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B ImageGen
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.3 8B Thinking Gemini Flash 11000x 128k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Meta-Llama-3-8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-experiment-v1-9B
Llama · RichardErkhov
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
LL
Llama 3.3 8B Instruct Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
gervasio 8b portuguese ptpt decoder
Llama · PORTULAN
Params8.03B
Context128K
Smallest16.1 GB
CodingTool use
LL
SLIMER PARALLEL LLaMA3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 JPRP NSFW 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ReasoningRoleplay
LL
Infinity Instruct 7M 0729 Llama3_1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Bioinspired Base Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool useVision
LL
Llama 3 8B Ultra Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 2 7b chat sexed version2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.3 70B Instruct Heretic v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3.1-8B-Think
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.2 3B Instruct
Llama · Abc7347
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
Llama3 8b It Prometheus Ko
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing