Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
llamas-community_llamaguard-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
tiny random LlamaForCausalLM
Llama · aladar
Params1M
Context2K
Smallest0.0 GB
LL
Meta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
gpt 4o distil Llama 3.3 70B Instruct PaperWitch heresy i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
models--Groq--Llama-3-Groq-8B-Tool-Use
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Collaiborator-MEDLLM-Llama-3-8B-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 70B OASST 1 200
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
dolphin 2.9.4 llama3.1 8b Q4 K M
Llama · yaneivan
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-262k
Llama · crusoeai
Params8B
Context256K
Q4_K_M4.9 GB
LL
Nous Hermes Llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
saraprice llama2 7B backdoor DEPLOYMENT
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
models--mergekit-community--Llama3-13B-ku
Llama · MaziyarPanahi
Params23B
Context8K
Q4_K_M13.9 GB
LL
llama 2 13B chat limarp v2 merged
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
meta-llama-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Chinese Llama 2 13B
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
llama 2 7B Guanaco QLoRA
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Meta Llama 3.1 405B Instruct
Llama · ThomasBaruzier
Params406B
Context128K
Q4_K_M243.1 GB
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Reasoning Llama 1b v0.1
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
dolphin 2.9 llama3 8b 256k GGUF smashed
Llama · PrunaAI
Params8B
Context512K
Q4_K_M4.9 GB
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
CodeLlama 7b Instruct Solidity i1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.2 uncensored erotica
Llama · hungng
Params3.21B
Context128K
Smallest6.4 GB
LL
Llama 3 ELYZA JP 8B
Llama · elyza
Params8B
Context8K
Q4_K_M4.9 GB