Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Meta-Llama-3-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Fireplace 13b
Llama · mradermacher
Params13B
Context16K
Q4_K_M8.4 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · mradermacher
Params8B
Context24K
Q4_K_M4.9 GB
LL
Llama 3.1 8B bnb 4bit wenyanwen
Llama · Quentin123
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
ProjectZLLM SFT dna Llama 3.1 8B Instruct 20 r16 merged
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
LL
Esper-70b
Llama · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
LL
toxicqa Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.1 8B Instruct Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 gutenberg 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Gradient 1048k
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · lahirum
Params3.21B
Context128K
Smallest1.9 GB
LL
Llama 3 Tulu v2.5 8b Uf Mean 70b Uf Rm
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 160m
Llama · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
models--mergekit-community--mergekit-ties-kkhkcqw
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 5p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct
Llama · second-state
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.1 8B Lexi Uncensored V2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 JPRP NSFW 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Kali Pentester
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Taiwan 8B Instruct
Llama · chienweichang
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Einstein-v6.1-LLama3-8B-Instruct-Ties
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
NeuralDaredevil-8B-abliterated-x-Llama-3-8B-instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Ko Luxia Instruct
Llama · QuantFactory
Params8.17B
Context8K
Q4_K_M5.0 GB
LL
Llama 3.1 8B Open SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama-7B-KStack
Llama · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama3.2 3B Math Gsm8K AutoSFT
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama3 TAIDE LX 8B Chat Alpha1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB