Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
shisa-v2-llama3.1-8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Saiga Llama3 L3 Stheno 8B v3.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
rombos Replete Coder Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama-3-8B-ShareGPT-112K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI Llama 3 8B Cumulus v0.3.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nirosunid Llama 3.1 8B bnb 4bit python v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
WizardLM 1.0 Uncensored CodeLlama 34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama-3-Instruct-8B-SimPO
Llama · legraphista
Params8.03B
Context8K
Smallest2.0 GB
GGUF
LL
Meta Llama 3 70B Instruct function calling i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Llama 2 7B 32K Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LL
Human Like LLama3 8B Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-120B-Instruct
Llama · mradermacher
Params122B
Context8K
Smallest26.0 GB
GGUF
LL
Llama-3-NeuralHercules-5.0-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Meta Llama 3.1 8B Instruct
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Coder-v2
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
llama-3-tulu-2-dpo-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
RuterNorway Llama 2 13b chat norwegian GGUF smashed
Llama · PrunaAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama3 8B Instruct Replete Adapted
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Roleplay-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Scarlett Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.2 3B Instruct
Llama · brittlewis12
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
LL
Meta Llama 3 8B Instruct function calling json mode
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 DeepDilemma V1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Distill ChatGPT o1
Llama · TurtleLiu
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llama3 8B Chinese Chat GGUF 4bit
Llama · shenzhi-wang
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
ADG Alpaca GPT4 LLaMa3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
jan hq Ichigo llama3.1 s instruct v0.4 step 7000
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Cogito v1 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use

Keep browsing