Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 8X3B MOE Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
GGUF
LL
Fireball Alpaca Llama3.1.08 8B Philos C R1 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama3.1 MOE 4X8B Gated IQ Multi Tier Deep Reasoning 32B
Llama · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningRoleplayTool use
LL
Llama OpenReviewer 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Collaiborator MEDLLM Llama 3 8B v1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Waktaverse Llama 3 KO 8B Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
MindCraft LLM tuning
Llama · Sweaterdog
Params7.6B
Context128K
Q4_K_M2.0 GB
GGUF
LL
llama-3-tulu-2-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8B UltraMedical
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Youko 70b Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Deep Reasoning Llama 3.2 Dolphin3.0 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
MiniThinky v2 1B Llama 3.2
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 EIRAI 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 OBLITERATED
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Fireball Llama 3.1 8B Philos Reflection v0.3 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Citrus1.0 Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · failspy
Params8B
Context8K
Smallest4.0 GB
GGUF
LL
Llama 2 7B vietnamese 20k
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.2 Chibi 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 1b
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
CodingTool use
LL
OrionStar Yi 34B Chat Llama
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Llama3 Aloe 8B Alpha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing