Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
llava llama 3 8b v1 1
Llama · xtuner
Params8B
Context8K
Smallest4.9 GB
LL
MathCoder2 CodeLlama 7B
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct abliterated
Llama · failspy
Params8B
Context8K
Smallest4.9 GB
LL
ToolACE 2.5 Llama 3.1 8B Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Calix CLM 1.0
Llama · calix-ai-labs
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Agent007 Coder
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 Tulu 3 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Kiel 2.1 Sol
Llama · kiel2
Params3.2B
Context128K
Q4_K_M2.0 GB
LL
Hermes 2 Theta Llama 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · mradermacher
Params16.5B
Context128K
Q4_K_M10.0 GB
LL
CodeLlama 13B MORepair
Llama · bartowski
Params13B
Context16K
Q4_K_M7.9 GB
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
LL
Mini Lama 8B Base
Llama · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
LL
llama 65b instruct
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Upstage Llama 2 70B instruct v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
alfredplpl Llama 3 8B Instruct Ja
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Emma 500 Llama2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama3.1 Nemo Thinker
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
llama3 8b chat uncensored
Llama · georgesung
Params8B
Context8K
Smallest4.7 GB
LL
Llama3 OpenBioLLM 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
openbuddy-llama3-70b-v21.2-32k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · DevQuasar-7
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LL
cognitivecomputations dolphin 2.9 llama3 8b
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct RoleVerse SFT DPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB