Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 3B Instruct
Llama · ThomasBaruzier
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
suzume llama 3 8B japanese i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
liberalis-cogitator-llama-3.1-8b-dpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.2 3B Instruct
Llama · second-state
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
nkpz_llama2-22b-daydreamer-v2
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
LL
LLaMA 2 7B 32K
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 8B Instruct 262k
Llama · Monor
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
llama-3-wissenschaft-8B-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Configurable Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
scb10x llama 3 typhoon v1.5x 70b instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
FuseChat Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
LLaMA 3 8B SFR Iterative DPO R
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Asclepius-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Code Llama Bagel 8B
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3 13B Instruct v0.1 GGUF smashed
Llama · PrunaAI
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
LL
MiniCPM-S-1B-sft-llama-format
Llama · mradermacher
Params1.47B
Context4K
Q4_K_M0.9 GB
GGUF
LL
Ziya Llama 13b Medical Merged
Llama · mradermacher
Params13.1B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ScaduTorrent1.1 8b model stock
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
OrcaAgent llama3.2 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct 8B SimPO
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · bullerwins
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
chinese llama 2 7b
Llama · hfl
Params6.93B
Context4K
Smallest2.6 GB
GGUF
LL
llama 3 Korean Bllossom 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · AlekseiPravdin
Params7.81B
Context128K
Q4_K_M4.8 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing