Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
models--MaziyarPanahi--Llama-3-70B-Instruct-32k-v0.1
Llama · MaziyarPanahi
Params70.6B
Context31K
Q4_K_M42.5 GB
GGUF
LL
ParaLex-Llama-3-8B-SFT
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grok oss Revenant 8B
Llama · c4tdr0ut
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
dolphin-2.9.3-llama-3-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 34b Python hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Tess R1 Limerick Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Huihui ai.Llama 3.1 Nemotron Nano 8B v1 Abliterated
Llama · DevQuasar-12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Heretic Llama Express.1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
PatronusAI Llama 3 Patronus Lynx 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 13B fp16 french
Llama · Nekochu
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
OpenBuddy Llama2 70b v10.1
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
LL
Llama Doctor 3.2 3B Instruct i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Clinical BR LlaMA 2 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama-3-Teal-Instruct-2x8B-MoE
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
LL
dolphin 2.9 llama3 8b
Llama · 3thn
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 kartoffeldes 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Lexi Llama 3 8B Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Portuguese v0.4
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Smaug-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama Ione 8B Roleplay v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
dolphin 2.9 llama3 8b flashback
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated Sabresooth
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
T3Q LLM3 Llama3 sft1.0 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
shisa v2.1 llama3.3 70b i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
llama 2 tiny random
Llama · aladar
Params—
Context4K
Smallest0.0 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DeepThought MOE 8X3B R1 Llama 3.2 Reasoning 18B i1
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
Reasoning
LL
Llama 3.1 ARC Potpourri Induction 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Vikhr Llama3.1 8B Instruct R 21 09 24
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing