Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Replete-Coder-Llama3-8B
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Karma Electric R1Distill Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3 8B Instruct japanese nk2t v0.2 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Physician-8B-Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
calme-3.2-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
llama3-8B-DarkIdol-1.0
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Physics Master
Llama · gallen881
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct Natural Questions
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3 8B Instruct Coder i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3 8B Uncensored 0.3 i1
Llama · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama_3.3_70b_Negative_Wayfarer_fusion_v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3 70B EnSecAI Ru Chat
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 Taiwan 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Reasoning
LL
Llama 3.2 3B Instruct Medical Finetuned merged
Llama · tinyopsec
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Ichigo llama3.1 s instruct v0.3 phase 2 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
AIML GEEK promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
mlfoundations dev llama2 oh teknium scaling down random 0.1
Llama · RichardErkhov
Params7B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Meta Llama 3 8B Instruct Jailbroken
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-64k
Llama · bartowski
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Minitron 4B Depth Base
Llama · QuantFactory
Params4.54B
Context128K
Q4_K_M2.8 GB
GGUF
LL
LlamaCorn 1.1B Chat
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
AndreyRzhaksinskiy CDS CodeLlama Ins 7b E2E 20241022
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Meta-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Sheep Duck Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama3.1 IgneousIguana 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct-ExPO
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama32 1b Llm Abliteration
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
LL
Llama-3-Groq-70B-Tool-Use
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use

Keep browsing