Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
read1337 Llama 3.1 8B bnb 4bit marketing
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Cybersecurity BaronLLM Offensive Security LLM Q6 K
Llama · AlicanKiraz0
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama3.1 8B Esper2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
reflection llama 3.1 8B Solshine Full i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Replete-Coder-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Samantha 1.11 CodeLlama 34B
Llama · second-state
Params33.7B
Context2K
Q4_K_M20.2 GB
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Bioinspired Llama 3 1 8B 128k alpha i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama 7b Instruct Solidity
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Dolphin Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama 3.1 8B TitanFusion
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
PatronusAI Llama 3 Patronus Lynx 70B Instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
llama 3.2 3b gsm8k
Llama · Anirudhpatil367
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
CleverBoi Llama 3.1 8B Python
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Smaug-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-abliterated-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
LlamaForecaster 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SenecaLLM x Llama3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
medicine Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Taiwan 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
llama-3-spicy-abliterated-stella-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama Guard 3 1B
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Lawyer Llama 13b v2
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.1 GB
LL
Llama 3 8B ArliAI Formax v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Medical Llama3 v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 161M 100B
Llama · QuantFactory
Params162M
Context1K
Q4_K_M0.1 GB
LL
llama3 8B Special Dark RP2 i1
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB