Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama3.1 BestMix Chem Einstein 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Foundation-Sec-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
LL
Website Builder Llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.2 1b 2025 uncensored v2 i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LocalAI functioncall llama3.2 1b v0.4
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.2 3B Instruct
Llama · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Llama-3-8B-Lexi-Uncensored
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Linkbricks Horizon AI Korean llama3.1 sft rlhf dpo 8B
Llama · Saxo
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 7b Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama-3-SauerkrautLM-8b-Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Cakrawala 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama3.1 8B Enigma
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Chinese
Llama · Rookie
Params8.03B
Context8K
Smallest6.1 GB
LL
Llama-3.1-70B-Instruct
Llama · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
LL
Llama PLLuM 8B Instruct 2512
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
jc9080 llama3 open ko 8b Instruct shimshimi 500 ver2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama OpenReviewer 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama PLLuM 70B Chat
Llama · Nondzu
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
models--allenai--tulu-2-dpo-13b
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
LL
Fireball Llama 3.1 8B v1dpo i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 Asobi 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Reasoner Llama3.1 70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama Spark
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3 Crab SFT
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Scarlett-Llama-3-8B-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.2 1b Train Aware Quantization
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB