Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
ELYZA-japanese-Llama-2-7b
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
LLaMA2 13B TiefighterLR
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 Peach Instruct 4x8B MoE
Llama · RDson
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
LL
Xiangxin 2XL Chat 1048k Chinese Llama3 70B i1
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 3B COT i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Taiwan LLaMa v0.9
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
calme-2.3-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Umievo-Shizuko-sqlcoder-2x8B
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
Coding
LL
Llama 4 Scout 17B 16E Instruct Abliterated
Llama · mradermacher
Params108B
Context10240K
Smallest39.6 GB
Vision
LL
Llama 3.1 8B MultiReflection Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 2 7b Chat Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama-3-8b-liquid-coding-agent
Llama · Liquid1
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-cat-8b-instruct-v1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OpenBuddy Llama2 13B v11.1
Llama · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CleverBoi Llama 3.1 8B v2
Llama · theprint
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct function calling
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama32_1Bn_Raft_Non_Traditional_Credentials
Llama · tituslhy
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
llama 3 70B instruct uncensored
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
wassimm Llama 3.1 8B psycology w 6k data
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
LL
Llama-3-Cantonese-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
8 Goldfish Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
dolphin-2.9-llama3-8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-70b-Arimas-story-RP-V1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Roleplay
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama3.1 Gutenberg 8B Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing