Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama-2-7b-WikiChat-fused
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
CodeLlama 7b Instruct Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama3Ternary 10b
Llama · CMSManhattan
Params9.64B
Context8K
Smallest4.3 GB
LL
rombos Llama3 8B Instruct Replete Adapted i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
LosslessMegaCoder Llama2 7B Mini
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Hermes 3 Llama 3.1 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2 DeepHermes 3 3B Preview Reasoning MAX NEO Imatrix
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.5 GB
LL
gguf lora llama3 midjourney prompt generator
Llama · rvian
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
UCCIX Llama2 13B i1
Llama · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
LL
Na0s Llama 3.1 8b Pruned 4 Layers
Llama · RichardErkhov
Params6.94B
Context128K
Q4_K_M4.3 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Llama 3.1 SuperNova Lite
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Claude
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct Heretic Ablitered Uncensored
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
LL
code Llama 2 13B i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · bartowski
Params51.5B
Context128K
Q4_K_M31.0 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
CodeUp Llama 2 13B Chat HF
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
nousresearch_yarn-llama-2-7b-64k
Llama · TheBloke
Params6.74B
Context64K
Q4_K_M4.1 GB
LL
Meta Llama 3 8B Instruct GGUF Imatrix smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
CodeLlama 70b Hf
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
LL
Llama 2 70B Ensemble v5
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
upstage_llama-30b-instruct-2048
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
ultravox v0 5 llama 3 1 8b
Llama · ggml-org
Params8B
Context128K
Q4_K_M4.9 GB