Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
ELYZA-japanese-Llama-2-7b-fast-instruct
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta-Llama-3-8B-Instruct
Llama · qwp4w3hyb
Params8B
Context8K
Q4_K_M4.9 GB
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama 7b Instruct hf
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
LL
Turkish Llama 8b Instruct v0.1
Llama · ytu-ce-cosmos
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Gradient 1048k GGUF smashed
Llama · PrunaAI
Params8B
Context1024K
Q4_K_M4.9 GB
LL
calme-2.1-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.3 70B Vulpecula R1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.3 70B Instruct Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nvidia.Llama 3 1 Nemotron Ultra 253B v1
Llama · DevQuasar-13
Params253B
Context128K
Q4_K_M150.9 GB
LL
Llama3-18B-lingyang-v1
Llama · mradermacher
Params18.1B
Context1024K
Q4_K_M10.9 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Configurable Llama 3.1 8B Instruct i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Bio Medical Llama 3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
llama2 7b chat codeCherryPop qLoRA
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 2 13B Chat
Llama · second-state
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.2 1B Instruct
Llama · DavidAU
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llama-3-70B-Instruct-abliterated
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
hon9kon9ize Cantonese Llama 2 7B preview20240625
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
SEVENLLM-Llama2-7B-CoT
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llama-3-sqlcoder-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
PiSSA Llama 2 7b R128
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
llama 2 7b chat sexed version5
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB