Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama Artemis
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Arabic llama3 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
LLama 3.1 1 million ctx Darkest Planet 16.5B
Llama · DavidAU
Params16.5B
Context1048K
Q4_K_M10.0 GB
LL
openbuddy llama3.1 8b v22.2 131k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Pingala8 2bit
Llama · Genrius-AI
Params2.89B
Context128K
Smallest2.4 GB
LL
Llama-3-8B-WildChat
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Humanish Roleplay Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
LLaMA3 Reasoning
Llama · mradermacher
Params157M
Context128
Q4_K_M0.1 GB
LL
Llama 3.2 1B Instruct Uncensored
Llama · brittlewis12
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Jan-Llama3-0708
Llama · mradermacher
Params8.04B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B instruct dansk i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Base Instruct SLERP
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Gradient 1048k GGUF v2
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
LL
Meta Llama 3 8B Instruct GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Prox-Llama-3-8B-abliterated-orpo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
ReWiz Llama 3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama Joycaption Beta One Hf Llava
Llama · filvyb
Params8B
Context128K
Smallest6.6 GB
LL
aixsatoshi Llama 3 8b Cosmopedia japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct RR Abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 8B Instruct 128K Absolute Heresy
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB