Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
r1 1776 distill llama 70b
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Ethical Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Jan-Llama3-0708
Llama · mradermacher
Params8.04B
Context8K
Q4_K_M4.9 GB
LL
badger writer llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B
Llama · DevQuasar-12
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
chinese llama 2 13b 16k
Llama · shaowenchen
Params13.3B
Context16K
Smallest5.6 GB
LL
Llama-3-8B-Instruct-DPO-v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 4 Scout 17B 6E Instruct
Llama · mradermacher
Params47.4B
Context10240K
Q4_K_M28.8 GB
LL
llama 3 8b 256k PoSE i1
Llama · mradermacher
Params8.03B
Context512K
Q4_K_M4.9 GB
LL
Mantella Skyrim Llama 3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
PsychoCounsel Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Mistral Small 3.2 24B Instruct 2506 Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 3.2 1B SQL
Llama · NotebookML
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLama3.1 Hawkish Theia Fireball 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama Magpie 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Tsukasa Llama 3 70b Qlora
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Tess 3 Llama 3.1 405B
Llama · bartowski
Params410B
Context128K
Q4_K_M245.7 GB
LL
Llama3.2 3B ShiningValiant2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
GlotMAX 17 14B
Llama · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Llama 3 6B Instruct v0.1
Llama · mradermacher
Params6.29B
Context8K
Q4_K_M3.9 GB
LL
Llama 3.1 8B Lexi Uncensored i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 7B LoRA Assemble
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Radiantloom Llama 70b Instruct
Llama · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
LL
Llama 3.1 8B AO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
EVA LLaMA 3.33 70B v0.0
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
DarkDesires LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB