Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
llama 3 bophades v2 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · LiteLLMs
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Arabic-Orpo-Llama-3-8B-Instruct
Llama · MohamedRashad
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama2 7B Hindi finetuned
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
DiamondForce
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
OpenMath2 Llama3.1 8B
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Sentient 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 3
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3 Med42 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes-2-Pro-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Reasoning Llama 1b v0.1
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Base NSFW pretrained e 0.5 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
tsukasa llama 3 8b qlora
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
LL
Turkish Llama 8b DPO v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLaMA2 13B Estopia
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
LLaMAX3 8B Alpaca
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 7b chat norwegian i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.2 SUN HDIC 1B Instruct
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
CodeLlama 7B KStack
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Valkyrie 49B v2.1
Llama · TheDrummer
Params50B
Context128K
Q4_K_M30.2 GB
LL
Llama3 TenyxChat 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama3 8B Chinese Chat GGUF 8bit
Llama · shenzhi-wang
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama 3 8b 64k PoSE GGUF smashed
Llama · PrunaAI
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB