Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Text to Sql llama3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
LL
Gemma 2 Llama Swallow 9b It v0.1
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3.1 Swallow 8B Instruct v0.1
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SunsetBoulevard
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3 Ko 8B Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
dfurman Llama 3 8B Orpo v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Obsidian
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Menlo ReZero v0.1 llama 3.2 3b it grpo 250404
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LightGPT 8B Llama3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
tchen175 llama3.1 8b per sent
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8b Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Taiwan 70B Instruct
Llama · chienweichang
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · OwenArli
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Name Classifier Llama3 8B 16b V2.2.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Einstein-v6.1-Llama3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Taigi Llama 2 Translator 13B
Llama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.0 GB
LL
Llama 3.1 Swallow 8B v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-UltraDPO2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
MFANN llama3.1 abliterated SLERP v3.1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Abliterated Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
aifeifei798 llama3 8B DarkIdol 2.1 Uncensored 32K
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 8X3B MOE Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
LL
Lama3.1 8B EksiSozlukAI
Llama · ozertuu
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Ultra-Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Base NSFW pretrained e 0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · mradermacher
Params8.03B
Context10K
Q4_K_M4.9 GB