Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Hermes-2-Theta-Llama-3-8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama lexi star uncensored 8b slerp
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NoFo codellama 13b v0.1 i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llama-3.2-3B-Instruct
Llama · mny1238
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Meta-Llama-3-7B-29Layers
Llama · mradermacher
Params7.38B
Context8K
Q4_K_M4.5 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 KokoroChat High i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Customer service question and answer
Llama · 3adel25
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
llama31 eros
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
scb10x llama 3 typhoon v1.5x 8b instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 7b chat Counsellor i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Laim Llama 3.1 MedPalm2 imitate 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
sepctrum ties sqlcoder 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
LL
ADG WizardLM LLaMa3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama DNA 1.0 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LogDoctor Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
firefly llama2 13B chat
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · arcee-ai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 8b merged
Llama · Cutyp
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI Llama 3 8B Cumulus v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 6B v0
Llama · RichardErkhov
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
LL
Bioinspired Llama 3 1 8B 128k gamma
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Peach-Instruct-4x8B-MoE
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
LL
Configurable Llama 3 8B v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 70B Instruct function calling
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
omost llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing