Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama Artemis
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Arabic llama3 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLama 3.1 1 million ctx Darkest Planet 16.5B
Llama · DavidAU
Params16.5B
Context1048K
Q4_K_M10.0 GB
RoleplayTool use
LL
openbuddy llama3.1 8b v22.2 131k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Pingala8 2bit
Llama · Genrius-AI
Params2.89B
Context128K
Smallest2.4 GB
GGUF
LL
Llama-3-8B-WildChat
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Humanish Roleplay Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
LLaMA3 Reasoning
Llama · mradermacher
Params157M
Context128
Q4_K_M0.1 GB
Reasoning
LL
Llama 3.2 1B Instruct Uncensored
Llama · brittlewis12
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Jan-Llama3-0708
Llama · mradermacher
Params8.04B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B instruct dansk i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Base Instruct SLERP
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k GGUF v2
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama 3 8B Instruct GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B EZO 1.1 it
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Prox-Llama-3-8B-abliterated-orpo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
ReWiz Llama 3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Llama Joycaption Beta One Hf Llava
Llama · filvyb
Params8B
Context128K
Smallest6.6 GB
Vision
LL
aixsatoshi Llama 3 8b Cosmopedia japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3 8B Instruct RR Abliterated
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Absolute Heresy
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF

Keep browsing