Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 4X3B MOE Ultra Instruct 10B
Llama · mradermacher
Params9.95B
Context128K
Q4_K_M6.1 GB
Tool use
LL
Llama3 8b chinese Uncensored v0.1
Llama · supernovaburn
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.2
Llama · cortexso
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
rombodawg_losslessmegacoder-llama2-13b-mini
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Coding
LL
Mermaid-Llama-6.7B-RAG-Code-Instruct
Llama · afrideva
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3.1 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Dolphin Instruct 11.5B
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
LL
Wayfarer Large 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
nousresearch_yarn-llama-2-7b-128k
Llama · TheBloke
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF
LL
llama 3.1 chinese 8b it dpo
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball Llama 3.1 8B Philos Reflection
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 8X3B GATED MOE Reasoning Dark Champion Instruct uncensored abliterated 18.4B
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.4 GB
ReasoningRoleplay
LL
Llama Guard 3 8B
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 3 8B dutch i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 8B Instruct Thinking Claude Haiku 4.5 High Reasoning 1700x
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Gemma 2 Llama Swallow 9b It v0.1 Heretic
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct 4bit
Llama · glogwa68
Params17B
Context9766K
Q4_K_M22.5 GB
GGUF
LL
Layerskip Llama3.2 1B
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3.2 1b Chatml RP i1
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
LL
Llama 3 8B Instruct DeepRefusal Broken
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-4194k
Llama · leafspark
Params8B
Context1K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
LL
chinese llama 2 13b
Llama · hfl
Params13.3B
Context4K
Smallest5.0 GB
Coding
LL
Llama3.1 8b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Firebal Llama 3.1 8B R1 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3 Base 8B SFT DPO
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · bartowski
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF

Keep browsing