Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M42.3 GB
GGUF
LL
OpenMath CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Asclepius Llama2 7B Pretraining Only
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 8B Web
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-13B-Instruct
Llama · LiteLLMs
Params13.9B
Context8K
Q4_K_M8.4 GB
GGUF
LL
GPT 5 Distill Llama3.2 3B Instruct Heretic
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.1 8B Osuda v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Skywork O1 Open Llama3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
mikael110_llama-2-70b-guanaco-qlora
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
Fireball Meta Llama 3.1 8B Instruct Agent 0.003 128K Code Ds Auto
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3 8B Instruct 262k GGUF smashed
Llama · PrunaAI
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.2
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1b Creative Writing Ablated
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
uukuguy speechless codellama orca platypus 13b 0.10e
Llama · RichardErkhov
Params430M
Context—
Q4_K_M0.0 GB
Coding
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
opus v1.2 llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SLIMER PARALLEL LLaMA3
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Taiwan LLaMa v1.0
Llama · audreyt
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama Gujarat 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ZhangShenao SELM Llama 3 8B Instruct iter 1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin3.0 Llama3.1 1B abliterated
Llama · NexesQuants
Params1.24B
Context128K
Smallest0.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 2 Pro Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · SanctumAI
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8B UltraMedical
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama PLLuM 70B Chat 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Bio Medical Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 DilemmaDeluxe 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
KawaiiMahou-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing