Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama3-Preferred-MedSwallow-70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Medichat-V2-Llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
allenai Llama 3.1 Tulu 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
FinGPT MT Llama 3 8B LoRA
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
LL
CodeLlama 13b Instruct Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
CodeLlama 7b Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Mahou 1.3 llama3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
TeenyTinyLlama-Doc-160m
Llama · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
LL
Llama 7B rollercoaster v2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · NousResearch
Params8B
Context8K
Q4_K_M4.9 GB
LL
uukuguy_speechless-codellama-34b-v2.0
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
toxicqa Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Meta Llama 3 8B Instruct GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3 8b It Translation Sharegpt En Ko
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3.2 3B Enigma
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama-3-Luminurse-v0.2-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama Sentient 3.2 3B Instruct i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
models--mergekit-community--mergekit-passthrough-kijjzjp
Llama · MaziyarPanahi
Params11.5B
Context8K
Q4_K_M7.0 GB
LL
hf 100 Llama 3.1 Spellbound StoryWriter 0.1 vllm 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 70b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
models--mergekit-community--mergekit-slerp-tzunwnr
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Athena-llama-Coder-3-8B
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
LL
code Llama 2 13B
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB