Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.3 8B Instruct 128K
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 SUN 2.5B Chat
Llama · mradermacher
Params2.47B
Context128K
Q4_K_M1.5 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · NousResearch
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama SEA LION v3 8B IT Magic_decensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 7b chat xgpt
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Einstein v6.1 Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3-UmbralMind-v1-15M
Llama · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
LL
Liberalis Cogitator Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
OpenMath2 Llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 Taiwan Legal 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama Poro 2 8B Long Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
LLaMAX2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · mradermacher
Params108B
Context10240K
Smallest22.2 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8b Cpt Sea Lionv3 Base
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Smaug 8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Meta Llama 3.1 8B Instruct
Llama · GPT4All-Community
Params8B
Context128K
Smallest4.7 GB
LL
FireStorm Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
ShiningValiantXS
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
HARC Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Hermes-2-Theta-Llama-3-70B-32k
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
LL
Llama 3.1 8B OmniMatrix
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-70b-Arimas-story-RP-V1.5
Llama · mradermacher
Params70.6B
Context256K
Q4_K_M42.5 GB
LL
Llama 3 8B Magpie Pro SFT 300K v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama Primus Nemotron 70B Instruct i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
PersianSciQA LLaMA 13B i1
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
LL
Hermes 2 Theta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB