Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
read1337 Llama 3.1 8B bnb 4bit marketing
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Cybersecurity BaronLLM Offensive Security LLM Q6 K
Llama · AlicanKiraz0
Params8.03B
Context128K
Smallest6.6 GB
Tool use
LL
Llama3.1 8B Esper2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
reflection llama 3.1 8B Solshine Full i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Samantha 1.11 CodeLlama 34B
Llama · second-state
Params33.7B
Context2K
Q4_K_M20.2 GB
Coding
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Bioinspired Llama 3 1 8B 128k alpha i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 7b Instruct Solidity
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Dolphin Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.1 8B TitanFusion
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
PatronusAI Llama 3 Patronus Lynx 70B Instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
llama 3.2 3b gsm8k
Llama · Anirudhpatil367
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
CleverBoi Llama 3.1 8B Python
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama-3-Smaug-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-abliterated-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LlamaForecaster 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
SenecaLLM x Llama3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
medicine Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Taiwan 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama-3-spicy-abliterated-stella-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Guard 3 1B
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
Lawyer Llama 13b v2
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Llama 3 8B ArliAI Formax v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Medical Llama3 v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 161M 100B
Llama · QuantFactory
Params162M
Context1K
Q4_K_M0.1 GB
GGUF
LL
llama3 8B Special Dark RP2 i1
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF

Keep browsing