Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Uncensored-Frank-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova Lite
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
self after dark
Llama · Gurubot
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
saiga llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct abliterated v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
CodeLlama-7B-KStack-clean
Llama · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
ELYZA japanese CodeLlama 7b
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama-3-Smaug-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 65b hf
Llama · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
LL
Llama3.1 TheiaFire DarkFusion 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Ultra-Instruct-SaltSprinkle
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Smaug-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
MopeyMule-Blackroot-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 70B Instruct Lorablated Creative Writer
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 3B Instruct
Llama · PrunaAI
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Meta Llama 3.1 70B Instruct
Llama · qwp4w3hyb
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
microsoft LLaMA 2 7b GTL Delta
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Llama3.2 3B ShiningValiant2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3_1-Nemotron-Ultra-253B-V1
Llama · unsloth
Params253B
Context128K
Q4_K_M150.9 GB
LL
HexaMind Llama3.1 8B S21 v29
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KokoroChat Low i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-2.2-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Bioinspired Llama 3 1 70B 128k Alpha
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ambuj Tripathi Indian Legal Llama
Llama · invincibleambuj
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLaMA 2 7B 32K
Llama · rozek
Params6.74B
Context32K
Q4_K_M4.1 GB
LL
Llama 3.2 6B AlgoCode
Llama · mradermacher
Params6.34B
Context128K
Q4_K_M5.6 GB
LL
llama 3 typhoon v1.5x 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB