Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Hermes-2-Theta-Llama-3-8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama lexi star uncensored 8b slerp
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
NoFo codellama 13b v0.1 i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama-3.2-3B-Instruct
Llama · mny1238
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Meta-Llama-3-7B-29Layers
Llama · mradermacher
Params7.38B
Context8K
Q4_K_M4.5 GB
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 KokoroChat High i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Customer service question and answer
Llama · 3adel25
Params8.03B
Context128K
Smallest16.1 GB
LL
llama31 eros
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
scb10x llama 3 typhoon v1.5x 8b instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 7b chat Counsellor i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Laim Llama 3.1 MedPalm2 imitate 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
sepctrum ties sqlcoder 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
LL
ADG WizardLM LLaMa3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama DNA 1.0 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LogDoctor Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
firefly llama2 13B chat
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
LL
Llama 3.1 SuperNova Lite
Llama · arcee-ai
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 8b merged
Llama · Cutyp
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ArliAI Llama 3 8B Cumulus v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 6B v0
Llama · RichardErkhov
Params6.29B
Context8K
Q4_K_M3.9 GB
LL
Bioinspired Llama 3 1 8B 128k gamma
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B
Llama · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Peach-Instruct-4x8B-MoE
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
LL
Configurable Llama 3 8B v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B Instruct function calling
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
omost llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB