Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
harborwater open llama 3b claude 30k
Llama · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
LL
Llama 3.1 Swallow 8B Instruct v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Bnb 4bit
Llama · jhangmez
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CDS CodeLlama 7b 20241113
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
philschmid code llama 3 1 8b text to sql
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3.1 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct Uncensored
Llama · Pola010101
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
shisa-v1-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 PersianQA
Llama · zpm
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 OpenBioMed 8B slerp v0.3 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 70B Instruct Abliterated v3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Nous Hermes Llama2 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.1 Amelia SD 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMa3-8b-WangchanX-sft-Full
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
m2hai unsensored 8b
Llama · m2hgamerz
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama3.1 8B Thinking R1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B Instruct Malaysian
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Qwen2P5 14b Llamatok
Llama · mradermacher
Params14.5B
Context32K
Q4_K_M8.8 GB
LL
Infinity Instruct 7M 0729 Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama-3-70b-Arimas-story-RP-V2.1
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
LL
llama 3 chinese 8b instruct
Llama · hfl
Params8.03B
Context8K
Smallest3.2 GB
LL
ELYZA-japanese-CodeLlama-7b-instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
EZO Llama 3.2 3B Instruct dpoE i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
BlenderCartel SCE Llama33 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3-Swallow-8B-instruct-vector-merged
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2 3b Leetcoder
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
LongWriter Llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
FunDialogues llamav2 LoRaco 7b merged
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB