Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M42.3 GB
LL
OpenMath CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
Asclepius Llama2 7B Pretraining Only
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3 8B Web
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta-Llama-3-13B-Instruct
Llama · LiteLLMs
Params13.9B
Context8K
Q4_K_M8.4 GB
LL
GPT 5 Distill Llama3.2 3B Instruct Heretic
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B Osuda v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Skywork O1 Open Llama3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mikael110_llama-2-70b-guanaco-qlora
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
LL
Fireball Meta Llama 3.1 8B Instruct Agent 0.003 128K Code Ds Auto
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct 262k GGUF smashed
Llama · PrunaAI
Params8.03B
Context256K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B Instruct v0.2
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 1b Creative Writing Ablated
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
uukuguy speechless codellama orca platypus 13b 0.10e
Llama · RichardErkhov
Params430M
Context—
Q4_K_M0.0 GB
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
opus v1.2 llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SLIMER PARALLEL LLaMA3
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Taiwan LLaMa v1.0
Llama · audreyt
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama Gujarat 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Dolphin3.0 Llama3.1 1B abliterated
Llama · NexesQuants
Params1.24B
Context128K
Smallest0.9 GB
LL
Meta Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 2 Pro Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · SanctumAI
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B UltraMedical
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Chat 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Bio Medical Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 DilemmaDeluxe 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KawaiiMahou-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB