Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
AMD Llama 135m code
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
Coding
LL
Llama Deepsync 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
LL
lightblue suzume llama 3 8B multilingual
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-V41-1048k
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Doktor-Llama-3-8b
Llama · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
GGUF
LL
colossal llama 2 7b base
Llama · shaowenchen
Params7.04B
Context4K
Smallest3.0 GB
GGUF
LL
Llama3-ChatQA-1.5-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-13B-Instruct-v0.1
Llama · QuantFactory
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Pro Coder v1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama Sentient 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.2 1b Uncensored RP Aesir
Llama · Novaciano
Params1.24B
Context128K
Smallest0.8 GB
Roleplay
LL
Llama 3 Smaug 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Portuguese v0.2 fft
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · lmstudio-community
Params108B
Context10240K
Q4_K_M67.5 GB
Vision
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
LL
Llama 3 8B Lexi Uncensored
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Turkish Llama 8b v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Mahou-1.2a-llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 70B ShiningValiant2 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
MMedS Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Magpie Align SFT v0.2 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama-3-8b-64k-PoSE
Llama · LiteLLMs
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LightGPT 13B Llama2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
tifa benchmark llama2 tifa question generation
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
grimjim Llama 3 Instruct demi merge 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
AMD Llama 135m
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing