Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Text to Sql llama3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
LL
Gemma 2 Llama Swallow 9b It v0.1
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.1
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SunsetBoulevard
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 3 Ko 8B Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dfurman Llama 3 8B Orpo v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Obsidian
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Menlo ReZero v0.1 llama 3.2 3b it grpo 250404
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8B EZO 1.1 it
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LightGPT 8B Llama3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
tchen175 llama3.1 8b per sent
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 8b Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3 Taiwan 70B Instruct
Llama · chienweichang
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · OwenArli
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Name Classifier Llama3 8B 16b V2.2.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Einstein-v6.1-Llama3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Taigi Llama 2 Translator 13B
Llama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
LL
Llama 3.1 Swallow 8B v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-UltraDPO2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MFANN llama3.1 abliterated SLERP v3.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Abliterated Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
aifeifei798 llama3 8B DarkIdol 2.1 Uncensored 32K
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 8X3B MOE Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
Tool use
LL
Lama3.1 8B EksiSozlukAI
Llama · ozertuu
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Ultra-Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Base NSFW pretrained e 0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · mradermacher
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF

Keep browsing