Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · bartowski
Params8B
Context1048K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.2 SUN 1B Chat
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
ReasoningTool use
LL
Llama3 German 8B 32k i1
Llama · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · backyardai
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 EIRAI 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
samantha-dolphin-llama-3
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Bio Medical Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Prox-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama SmolTalk 3.2 1B Instruct i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Jallabi 40B
Llama · mradermacher
Params18.8B
Context4K
Q4_K_M11.3 GB
GGUF
LL
Llama-3-8B-Lexi-Smaug-Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
llama-3-chinese-8b-instruct-v3
Llama · hfl
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama3-Med42-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Agent007 Coder i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LL
LLama 3.1 4B TitanFusion
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Meta Llama Guard 2 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Groq 70B Tool Use
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
siemens s7 honeypot llama3B v2
Llama · AckerHHHH
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama3.1 BestMix Chem Einstein 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Medichat Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Open Llama 7b v2 Open Instruct
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama3.1 Vodka
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
MiniCPM Llama3 V 2 5
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingVision
LL
llama 2 7b langchain chat
Llama · YanaS
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing