Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Luna AI Llama2 Uncensored i1
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama3 ChatQA 2 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-OpenHermes-243K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 3B Instruct Heretic Ablitered Uncensored
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
llama3 42b v0 i1
Llama · mradermacher
Params43.2B
Context8K
Q4_K_M26.1 GB
GGUF
LL
Meta Llama 3 2x8B Instruct MoE 64k ctx
Llama · mradermacher
Params13.7B
Context64K
Q4_K_M8.3 GB
GGUF
LL
Gemma 2 Llama Swallow 9b it v0.1 Heretic
Llama · ChiKoi7
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama3 OpenBioLLM 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 11B Instruct v0.1
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · leafspark
Params70.6B
Context128K
Smallest15.3 GB
Tool use
LL
CodeActAgent Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
Llamazing 3.1 8B Instruct i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grok oss Revenant 70B
Llama · c4tdr0ut
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama Gujarat 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
rinna llama 3 youko 8b
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 3 Nemotron Super 49B v1 5 i1
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
ReasoningTool use
LL
dolphin 2.9.4 llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Synatra 11B v1
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
DeepHermes 3 Llama 3 3B Preview
Llama · NousResearch
Params3.21B
Context128K
Smallest1.9 GB
ReasoningRoleplayTool use
LL
Llama 3 8B LexiFun Uncensored V1
Llama · nitsuai
Params8B
Context—
Q4_K_M4.9 GB
Roleplay
LL
Llama-3-Swallow-8B-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · SanctumAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct DADA iMat
Llama · Quant-Cartel
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLama 3.1 8B HyperNova
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · Andycurrent
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Hermes-2-Pro-Llama-3-8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
L3.1 Aglow Vulca v0.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
omed llama3 8b i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing