Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-SOVL-MopeyMule-Blackroot-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArrowCanaria Llama 8B SFT v0.1
Llama · mmnga-o
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
hermes llama3 roleplay 1000 v8 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3.1 Unhinged Vision 8B
Llama · YuujiLab
Params8.03B
Context8K
Q4_K_M4.9 GB
Vision
LL
Llama 3 8B Orpo v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-aaditya-OpenBioLLM-Blackroot-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 ELYZA JP 8B Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Guard 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.2 3B f32
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 4 Scout 17B 16E Instruct
Llama · steampunque
Params108B
Context10240K
Smallest42.8 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · Andycurrent
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
HarmBench Llama 2 13b Cls
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
llama-3-neural-chat-v1-8b
Llama · nitsuai
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama-xLAM-2-8b-fc-r
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
Tool use
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 70B DPO
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
FlexGuard LLaMA3.1 Instruct 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Genius Llama3.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA3 8B 8bit DepressionDetection Reddit
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 8b English to Hinglish
Llama · Hinglish-Project
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama2 70b chat uncensored
Llama · YokaiKoibito
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
Kudzu-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B blueVi
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Qwen1.5 72B Chat LLaMAfied
Llama · mradermacher
Params72.3B
Context32K
Q4_K_M45.2 GB
GGUF
LL
LLama 3.1 8B HyperNova
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
calme-2.2-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Ollama Video llama 7B
Llama · ManishThota
Params6.74B
Context4K
Smallest13.5 GB
Vision
LL
Vegybin11 Llama 3.1 8B bnb 4bit python
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama3.2 1B physics finetuned
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama-3-Deppressed-Therapist-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing