Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
AMD Llama 135m code
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
LL
Llama Deepsync 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
lightblue suzume llama 3 8B multilingual
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-V41-1048k
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Doktor-Llama-3-8b
Llama · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
LL
colossal llama 2 7b base
Llama · shaowenchen
Params7.04B
Context4K
Smallest3.0 GB
LL
Llama3-ChatQA-1.5-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-13B-Instruct-v0.1
Llama · QuantFactory
Params13.3B
Context8K
Q4_K_M8.1 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Pro Coder v1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Sentient 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.2 1b Uncensored RP Aesir
Llama · Novaciano
Params1.24B
Context128K
Smallest0.8 GB
LL
Llama 3 Smaug 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Portuguese v0.2 fft
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · lmstudio-community
Params108B
Context10240K
Q4_K_M67.5 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LL
Llama 3 8B Lexi Uncensored
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Turkish Llama 8b v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Mahou-1.2a-llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3 70B ShiningValiant2 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
MMedS Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Magpie Align SFT v0.2 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8b-64k-PoSE
Llama · LiteLLMs
Params8B
Context128K
Q4_K_M4.9 GB
LL
LightGPT 13B Llama2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
tifa benchmark llama2 tifa question generation
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
grimjim Llama 3 Instruct demi merge 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
AMD Llama 135m
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB