Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
EZ PoC Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 Reddit Writer 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Nova 70B Llama 3.3
Llama · LatitudeGames
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
cognitivecomputations Llama 3 8B Instruct abliterated v2 GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ChatQA-1.5-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
meta llama CodeLlama 34b Instruct hf
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Llama 3.2 1b Creative Writing Ablated
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Apollo2 9B Llamacppfixed
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3.2 3B Instruct Candor Uncensored
Llama · candor-lab
Params3.21B
Context128K
Q4_K_M2.4 GB
LL
Meta Llama 3 8B Instruct
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 2 7b langchain chat
Llama · shaowenchen
Params6.74B
Context4K
Smallest2.8 GB
LL
Lama DPOlphin 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Aion RP Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Gemma 2 Llama Swallow 9b Pt v0.1
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Polyglot V2 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
bling sheared llama 2.7b 0.1
Llama · afrideva
Params2.7B
Context4K
Q4_K_M1.6 GB
LL
Llama SEA LION v3 8B IT
Llama · aisingapore
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 2 7b langchain chat
Llama · lucianosb
Params6.74B
Context4K
Smallest3.8 GB
LL
OpenMath CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
LL
ChatParts Llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8b-tagalog-v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Romulus cpt Llama 3.1 8B v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · bullerwins
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-SOVL-aaditya-OpenBioLLM-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Home Llama 3.2 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama2 70B SunsetBoulevard
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
CodeLlama3.2 3B 1225
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB