Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
shisa-v2-llama3.1-8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Saiga Llama3 L3 Stheno 8B v3.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
rombos Replete Coder Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-ShareGPT-112K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ArliAI Llama 3 8B Cumulus v0.3.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
nirosunid Llama 3.1 8B bnb 4bit python v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
WizardLM 1.0 Uncensored CodeLlama 34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Llama-3-Instruct-8B-SimPO
Llama · legraphista
Params8.03B
Context8K
Smallest2.0 GB
LL
Meta Llama 3 70B Instruct function calling i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 2 7B 32K Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
LL
Human Like LLama3 8B Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta-Llama-3-120B-Instruct
Llama · mradermacher
Params122B
Context8K
Smallest26.0 GB
LL
Llama-3-NeuralHercules-5.0-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Uz
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-Coder-v2
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-tulu-2-dpo-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
RuterNorway Llama 2 13b chat norwegian GGUF smashed
Llama · PrunaAI
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama3 8B Instruct Replete Adapted
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Roleplay-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Scarlett Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · brittlewis12
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Meta Llama 3 8B Instruct function calling json mode
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 DeepDilemma V1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Distill ChatGPT o1
Llama · TurtleLiu
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama3 8B Chinese Chat GGUF 4bit
Llama · shenzhi-wang
Params8.03B
Context8K
Smallest4.7 GB
LL
ADG Alpaca GPT4 LLaMa3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
jan hq Ichigo llama3.1 s instruct v0.4 step 7000
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Cogito v1 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB