Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
ELYZA-japanese-Llama-2-7b
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
LLaMA2 13B TiefighterLR
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 Peach Instruct 4x8B MoE
Llama · RDson
Params24.9B
Context8K
Q4_K_M15.2 GB
LL
Xiangxin 2XL Chat 1048k Chinese Llama3 70B i1
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
LL
Llama 3.2 3B COT i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Taiwan LLaMa v0.9
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
calme-2.3-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3-Umievo-Shizuko-sqlcoder-2x8B
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
LL
Llama 4 Scout 17B 16E Instruct Abliterated
Llama · mradermacher
Params108B
Context10240K
Smallest39.6 GB
LL
Llama 3.1 8B MultiReflection Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 7b Chat Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
llama-3-8b-liquid-coding-agent
Llama · Liquid1
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-cat-8b-instruct-v1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OpenBuddy Llama2 13B v11.1
Llama · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
LL
CleverBoi Llama 3.1 8B v2
Llama · theprint
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct function calling
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama32_1Bn_Raft_Non_Traditional_Credentials
Llama · tituslhy
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llama 3 70B instruct uncensored
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
wassimm Llama 3.1 8B psycology w 6k data
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
LL
Llama-3-Cantonese-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
8 Goldfish Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
dolphin-2.9-llama3-8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-70b-Arimas-story-RP-V1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 Gutenberg 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB