Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 3B COT
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Polypsyche Llama 3.1 8B Instruct Agent 0.0031 128K code ds auto divergent i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
dolphin3 nsfw gf chat
Llama · jmachine
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Arabic Orpo Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
reflection llama 3.1 8B Solshine Full
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 3 8b instruct 262k chinese
Llama · Monor
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
Llama Poro 2 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
FactAlign LLaMA 3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
GGUF dataset avaliev chat doctor unsolth llama3.1 1b3bconverstional
Llama · RahulDrabit
Params460M
Context—
Q4_K_M0.3 GB
GGUF
LL
Smol_Llama 4x220M MoE
Llama · mradermacher
Params595M
Context2K
Q4_K_M0.4 GB
CodingTool use
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.x 70b Tess Cat 128K v1.0 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
SpellBlade
Llama · mradermacher
Params69B
Context4K
Q4_K_M42.3 GB
GGUF
LL
Llama3 Instruct OpenBioLLM 8B merged i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
hermes llama3 roleplay 2000 v3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
AIML GEEK advanced promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama OuteTTS 1.0 1B
Llama · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
GGUF
LL
Llama 3.2 3b NSFW Aesir Uncensored
Llama · Anubis136
Params3.61B
Context128K
Smallest2.0 GB
RoleplayTool use
LL
Llama3.1 SuperHawk 8B Heretic v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama PLLuM 8B Chat 2412
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
OpenMath2 Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
MMed Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Diffusion Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
shisa-v2-llama3.3-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 ELYZA JP 8B Heretic
Llama · ChiKoi7
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 ELYZA JP 8B Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing