Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.3 8B Instruct 128K
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 SUN 2.5B Chat
Llama · mradermacher
Params2.47B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
LL
DeepHermes 3 Llama 3 8B Preview
Llama · NousResearch
Params8.03B
Context128K
Smallest4.7 GB
ReasoningRoleplayTool use
LL
Llama SEA LION v3 8B IT Magic_decensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 7b chat xgpt
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Einstein v6.1 Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3-UmbralMind-v1-15M
Llama · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
Roleplay
LL
Liberalis Cogitator Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
OpenMath2 Llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 Taiwan Legal 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama Poro 2 8B Long Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMAX2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · mradermacher
Params108B
Context10240K
Smallest22.2 GB
GGUF
LL
ZhangShenao SELM Llama 3 8B Instruct iter 2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8b Cpt Sea Lionv3 Base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · GPT4All-Community
Params8B
Context128K
Smallest4.7 GB
GGUF
LL
FireStorm Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ShiningValiantXS
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
HARC Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes-2-Theta-Llama-3-70B-32k
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.1 8B OmniMatrix
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-70b-Arimas-story-RP-V1.5
Llama · mradermacher
Params70.6B
Context256K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3 8B Magpie Pro SFT 300K v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Primus Nemotron 70B Instruct i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
PersianSciQA LLaMA 13B i1
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Hermes 2 Theta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use

Keep browsing