Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
llamas-community_llamaguard-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
tiny random LlamaForCausalLM
Llama · aladar
Params1M
Context2K
Smallest0.0 GB
GGUF
LL
Meta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
gpt 4o distil Llama 3.3 70B Instruct PaperWitch heresy i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
models--Groq--Llama-3-Groq-8B-Tool-Use
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Collaiborator-MEDLLM-Llama-3-8B-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 70B OASST 1 200
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b Q4 K M
Llama · yaneivan
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-262k
Llama · crusoeai
Params8B
Context256K
Q4_K_M4.9 GB
GGUF
LL
Nous Hermes Llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
LL
saraprice llama2 7B backdoor DEPLOYMENT
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
LL
models--mergekit-community--Llama3-13B-ku
Llama · MaziyarPanahi
Params23B
Context8K
Q4_K_M13.9 GB
Tool use
LL
llama 2 13B chat limarp v2 merged
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
meta-llama-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Chinese Llama 2 13B
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
llama 2 7B Guanaco QLoRA
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Meta Llama 3.1 405B Instruct
Llama · ThomasBaruzier
Params406B
Context128K
Q4_K_M243.1 GB
Tool use
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Reasoning Llama 1b v0.1
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning
LL
dolphin 2.9 llama3 8b 256k GGUF smashed
Llama · PrunaAI
Params8B
Context512K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama 7b Instruct Solidity i1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3.2 uncensored erotica
Llama · hungng
Params3.21B
Context128K
Smallest6.4 GB
GGUF
LL
Llama 3 ELYZA JP 8B
Llama · elyza
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing