Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
r1 1776 distill llama 70b
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Ethical Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Jan-Llama3-0708
Llama · mradermacher
Params8.04B
Context8K
Q4_K_M4.9 GB
GGUF
LL
badger writer llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B
Llama · DevQuasar-12
Params3.61B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
LL
chinese llama 2 13b 16k
Llama · shaowenchen
Params13.3B
Context16K
Smallest5.6 GB
GGUF
LL
Llama-3-8B-Instruct-DPO-v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B SFT
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Vision
LL
Llama 4 Scout 17B 6E Instruct
Llama · mradermacher
Params47.4B
Context10240K
Q4_K_M28.8 GB
Tool useVision
LL
llama 3 8b 256k PoSE i1
Llama · mradermacher
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
LL
Mantella Skyrim Llama 3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
PsychoCounsel Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Mistral Small 3.2 24B Instruct 2506 Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
LL
Llama 3.2 1B SQL
Llama · NotebookML
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
LLama3.1 Hawkish Theia Fireball 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama Magpie 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
Tsukasa Llama 3 70b Qlora
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Tess 3 Llama 3.1 405B
Llama · bartowski
Params410B
Context128K
Q4_K_M245.7 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
GlotMAX 17 14B
Llama · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
LL
Llama 3 6B Instruct v0.1
Llama · mradermacher
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 7B LoRA Assemble
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Radiantloom Llama 70b Instruct
Llama · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
Llama 3.1 8B AO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
EVA LLaMA 3.33 70B v0.0
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
DarkDesires LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing