Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.2 3B Instruct
Llama · ThomasBaruzier
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
suzume llama 3 8B japanese i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
liberalis-cogitator-llama-3.1-8b-dpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · second-state
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nkpz_llama2-22b-daydreamer-v2
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
LL
LLaMA 2 7B 32K
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
LL
Llama 3 8B Instruct 262k
Llama · Monor
Params8.03B
Context256K
Q4_K_M4.9 GB
LL
llama-3-wissenschaft-8B-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Configurable Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
scb10x llama 3 typhoon v1.5x 70b instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
FuseChat Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLaMA 3 8B SFR Iterative DPO R
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Asclepius-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Code Llama Bagel 8B
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 13B Instruct v0.1 GGUF smashed
Llama · PrunaAI
Params13.3B
Context8K
Q4_K_M8.1 GB
LL
MiniCPM-S-1B-sft-llama-format
Llama · mradermacher
Params1.47B
Context4K
Q4_K_M0.9 GB
LL
Ziya Llama 13b Medical Merged
Llama · mradermacher
Params13.1B
Context2K
Q4_K_M7.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ScaduTorrent1.1 8b model stock
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OrcaAgent llama3.2 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B SimPO
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B Instruct
Llama · bullerwins
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
chinese llama 2 7b
Llama · hfl
Params6.93B
Context4K
Smallest2.6 GB
LL
llama 3 Korean Bllossom 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · AlekseiPravdin
Params7.81B
Context128K
Q4_K_M4.8 GB
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB