Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Configurable-Hermes-2-Pro-Llama-3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3 8B OpenHermes DPO
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Fireball Llama 3.1 8B Philos Relection i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Luminurse-v0.2-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
bangla-llama-7b-instruct-v0.1
Llama · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
LL
Llama-3-8B-Instruct-abliterated-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
llama 3.2 3b chat doctor i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 Taiwan 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Fireball 3.1 8B ORPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1_OpenScholar 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-2.1-Uncensored-32K
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Stheno-Instruct-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama SmolTalk 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llama3 42b v0 GGUF smashed
Llama · PrunaAI
Params43.2B
Context8K
Smallest16.3 GB
LL
llama 3 70B instruct uncensored i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Joah-Llama-3-KoEn-8B-Coder-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · AI-Engine
Params8.03B
Context128K
Smallest3.2 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · second-state
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-8B-Instruct
Llama · AI-Engine
Params8.03B
Context8K
Smallest3.2 GB
LL
Llama portuguese 13b Luana v0.2 i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama-3-WhiteRabbitNeo-8B-v2.0
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8B Chinese Chat
Llama · second-state
Params8B
Context128K
Q4_K_M4.9 GB
LL
Reflection Llama 3.1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · HiddenViper229
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B ORPO Advertisement
Llama · yothinS
Params3.2B
Context128K
Smallest1.4 GB
LL
OpenBioLLM Llama3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B TitanFusion
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB