Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
nkpz_llama2-22b-daydreamer-v3
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
LL
Cogito v1 Preview Llama 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Mopeyfied-Psychology-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-2.1-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama32 1b Llm Abliteration
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Llama-3-8B-Irene-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Taigi Llama 2 Translator 7B
Llama · RichardErkhov
Params6.94B
Context4K
Q4_K_M4.2 GB
LL
Llama3 German 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama OuteTTS 1.0 1B
Llama · OuteAI
Params1.25B
Context128K
Q4_K_M0.8 GB
LL
Bio Medical Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3.1-Argunaut-1-8B-HIRPO
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Alpha Ko 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
cyber risk llama 3 8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Infinity-Instruct-3M-0613-Llama3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
bavest_fin-llama-33b-merged
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
Home Llama 3.2 3B
Llama · acon96
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
flozi00_llama-2-13b-german-assistant-v4
Llama · TheBloke
Params13.1B
Context2K
Q4_K_M7.9 GB
LL
Llama 3.1 70B Instruct lorablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Mahou-1.3b-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ShiningValiant 1.2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
sheep duck llama 2 70b v1.1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3.1 8B Reason Blend 888k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Lexi Llama 3 8B Uncensored
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB