Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
ELYZA-japanese-Llama-2-7b-fast-instruct
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta-Llama-3-8B-Instruct
Llama · qwp4w3hyb
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 7b Instruct hf
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Coding
LL
Turkish Llama 8b Instruct v0.1
Llama · ytu-ce-cosmos
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k GGUF smashed
Llama · PrunaAI
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
calme-2.1-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
LL
Llama 3.3 70B Vulpecula R1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Llama 3.3 70B Instruct Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
nvidia.Llama 3 1 Nemotron Ultra 253B v1
Llama · DevQuasar-13
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
LL
Llama3-18B-lingyang-v1
Llama · mradermacher
Params18.1B
Context1024K
Q4_K_M10.9 GB
GGUF
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Configurable Llama 3.1 8B Instruct i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Bio Medical Llama 3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama2 7b chat codeCherryPop qLoRA
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 13B Chat
Llama · second-state
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · DavidAU
Params1.24B
Context128K
Q4_K_M0.8 GB
Roleplay
LL
llama-3-70B-Instruct-abliterated
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
hon9kon9ize Cantonese Llama 2 7B preview20240625
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
SEVENLLM-Llama2-7B-CoT
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
LL
llama-3-sqlcoder-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
PiSSA Llama 2 7b R128
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 2 7b chat sexed version5
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing