Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.2 4X3B MOE Ultra Instruct 10B
Llama · mradermacher
Params9.95B
Context128K
Q4_K_M6.1 GB
LL
Llama3 8b chinese Uncensored v0.1
Llama · supernovaburn
Params8B
Context8K
Q4_K_M4.9 GB
LL
llama3.2
Llama · cortexso
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
rombodawg_losslessmegacoder-llama2-13b-mini
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Mermaid-Llama-6.7B-RAG-Code-Instruct
Llama · afrideva
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.1 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 Dolphin Instruct 11.5B
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
LL
Wayfarer Large 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nousresearch_yarn-llama-2-7b-128k
Llama · TheBloke
Params6.74B
Context128K
Q4_K_M4.1 GB
LL
llama 3.1 chinese 8b it dpo
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Fireball Llama 3.1 8B Philos Reflection
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 8X3B GATED MOE Reasoning Dark Champion Instruct uncensored abliterated 18.4B
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.4 GB
LL
Llama Guard 3 8B
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
LL
Llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Llama 3 8B dutch i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 8B Instruct Thinking Claude Haiku 4.5 High Reasoning 1700x
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Gemma 2 Llama Swallow 9b It v0.1 Heretic
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 4 Scout 17B 16E Instruct 4bit
Llama · glogwa68
Params17B
Context9766K
Q4_K_M22.5 GB
LL
Layerskip Llama3.2 1B
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.2 1b Chatml RP i1
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Llama 3 8B Instruct DeepRefusal Broken
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-Gradient-4194k
Llama · leafspark
Params8B
Context1K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LL
chinese llama 2 13b
Llama · hfl
Params13.3B
Context4K
Smallest5.0 GB
LL
Llama3.1 8b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Firebal Llama 3.1 8B R1 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Base 8B SFT DPO
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · bartowski
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB