Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3 Instruct 8B SPPO Iter3 SimPO Merge
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama_3.3_70b_L3.3 NegativeLlama_abliterated_fusion_norm
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
danbooru llama i1
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Pauper Llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3-KawaiiMahouSauce-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
BramVanroy llama2 13b ft mc4 nl cleaned tiny
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.2
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
LL
Opus Samantha Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · chatpig
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 13b Hf
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
cais HarmBench Llama 2 13b cls multimodal behaviors
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
Impish_LLAMA_3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
vicgalle Configurable Llama 3 8B v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8B Cobalt
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 TenyxChat 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.2 Korean Bllossom 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
calme-3.3-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
CodeLlama3 8B Python
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Dolphin3.0-Llama3.2-3B
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 DeepHermes R1 Reasoning 8B DarkIdol Instruct 1.2 Uncensored
Llama · DavidAU
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
FineLlama 3.1 8B
Llama · clodbrasilino
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 pruned 45B Drobeta Turnu Severin i1
Llama · mradermacher
Params44.9B
Context8K
Q4_K_M27.1 GB
LL
Llama3.1 8b small Instructed
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3-tweety-8b-italian
Llama · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama-3-8B-instruct
Llama · AI-Sweden-Models
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Pruned 4 Layers LoRA PEFT 3.0
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
LL
Cakrawala 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo collective cognition
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA2-13B-Estopia
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB