Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama Phi 3 DoRA i1
Llama · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
LL
ShiningValiantXS i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.4 GB
GGUF
LL
Llama 2 7b WikiChat
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Impish_LLAMA_3B
Llama · l3utterfly
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Trendyol LLM 8b Chat v2.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Herplete LLM Llama 3.1 8b i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
shisa v2.1 llama3.2 3b
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
LLaMAX2-7B-MetaMath
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
Roleplay
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Ultra Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Rombos LLM 70b Llama 3.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Logical-elyza-llama2-7b-fast-instruct
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
CodingRoleplay
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Heretic V1 1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Wayfarer Large 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3 16B Instruct v0.1
Llama · MaziyarPanahi
Params16.8B
Context8K
Q4_K_M10.2 GB
GGUF
LL
CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ausboss_llama-30b-supercot
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF

Keep browsing