Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
EZ PoC Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama3.1 Reddit Writer 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Nova 70B Llama 3.3
Llama · LatitudeGames
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LL
cognitivecomputations Llama 3 8B Instruct abliterated v2 GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ChatQA-1.5-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
meta llama CodeLlama 34b Instruct hf
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 3.2 1b Creative Writing Ablated
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Apollo2 9B Llamacppfixed
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3.2 3B Instruct Candor Uncensored
Llama · candor-lab
Params3.21B
Context128K
Q4_K_M2.4 GB
Tool use
LL
Meta Llama 3 8B Instruct
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 2 7b langchain chat
Llama · shaowenchen
Params6.74B
Context4K
Smallest2.8 GB
GGUF
LL
Lama DPOlphin 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Aion RP Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.3 SuperSwallow 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Gemma 2 Llama Swallow 9b Pt v0.1
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Polyglot V2 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
bling sheared llama 2.7b 0.1
Llama · afrideva
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
LL
Llama SEA LION v3 8B IT
Llama · aisingapore
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 2 7b langchain chat
Llama · lucianosb
Params6.74B
Context4K
Smallest3.8 GB
GGUF
LL
OpenMath CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
Coding
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
LL
ChatParts Llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8b-tagalog-v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Romulus cpt Llama 3.1 8B v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · bullerwins
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-SOVL-aaditya-OpenBioLLM-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Home Llama 3.2 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama2 70B SunsetBoulevard
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
CodeLlama3.2 3B 1225
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use

Keep browsing