Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 Instruct 8B SPPO Iter3 SimPO Merge
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama_3.3_70b_L3.3 NegativeLlama_abliterated_fusion_norm
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
danbooru llama i1
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Pauper Llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-KawaiiMahouSauce-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
BramVanroy llama2 13b ft mc4 nl cleaned tiny
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v4.1.2
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Opus Samantha Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B
Llama · chatpig
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 13b Hf
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
cais HarmBench Llama 2 13b cls multimodal behaviors
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Impish_LLAMA_3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
vicgalle Configurable Llama 3 8B v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Cobalt
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3 TenyxChat 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 Korean Bllossom 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Llama 3.1 Amelia MTFT 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
calme-3.3-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
CodeLlama3 8B Python
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Dolphin3.0-Llama3.2-3B
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LL
Llama 3.1 DeepHermes R1 Reasoning 8B DarkIdol Instruct 1.2 Uncensored
Llama · DavidAU
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
FineLlama 3.1 8B
Llama · clodbrasilino
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 pruned 45B Drobeta Turnu Severin i1
Llama · mradermacher
Params44.9B
Context8K
Q4_K_M27.1 GB
GGUF
LL
Llama3.1 8b small Instructed
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3-tweety-8b-italian
Llama · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-8B-instruct
Llama · AI-Sweden-Models
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Pruned 4 Layers LoRA PEFT 3.0
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
Tool use
LL
Cakrawala 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo collective cognition
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA2-13B-Estopia
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing