Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Replete-Coder-Llama3-8B
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Karma Electric R1Distill Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct japanese nk2t v0.2 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Physician-8B-Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
calme-3.2-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llama3-8B-DarkIdol-1.0
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Physics Master
Llama · gallen881
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct Natural Questions
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3 8B Instruct Coder i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Uncensored 0.3 i1
Llama · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
Llama_3.3_70b_Negative_Wayfarer_fusion_v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3 70B EnSecAI Ru Chat
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.2 Taiwan 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Llama 3.2 3B Instruct Medical Finetuned merged
Llama · tinyopsec
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Ichigo llama3.1 s instruct v0.3 phase 2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AIML GEEK promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
mlfoundations dev llama2 oh teknium scaling down random 0.1
Llama · RichardErkhov
Params7B
Context4K
Q4_K_M4.1 GB
LL
Meta Llama 3 8B Instruct Jailbroken
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta-Llama-3-8B-Instruct-64k
Llama · bartowski
Params8.03B
Context64K
Q4_K_M4.9 GB
LL
Llama 3.1 Minitron 4B Depth Base
Llama · QuantFactory
Params4.54B
Context128K
Q4_K_M2.8 GB
LL
LlamaCorn 1.1B Chat
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AndreyRzhaksinskiy CDS CodeLlama Ins 7b E2E 20241022
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Meta-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Sheep Duck Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama3.1 IgneousIguana 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Smaug-Llama-3-70B-Instruct-ExPO
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama32 1b Llm Abliteration
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB