Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
llama-3-8B-rpg-v4
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Synthia-v3.5
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
DevsDoCode LLama 3 8b Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-MagPO
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
models--mergekit-community--mergekit-slerp-oztfijl
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
PlatYi 34B Llama Q v3
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
Llama Poro 2 8B Long Base
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
LlamaCorn 1.1B Chat
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Laravel 11 Llama 3.2 1B Instruct
Llama · yannelli
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama3.2 3B Esper2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
UserLM-8b
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.3 GB
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Unichat llama3 Chinese 8B GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
LL
Evolved Llama3 8B
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Codepy Deepthink 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
LLaMA2 13B Holomax
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.1 8B Ultra Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
LLama 3.1 8B Matrix i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3-ChatQA-1.5-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Dirty Alice RP NSFW Llama 3.2 1B
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
cognitivecomputations dolphin 2.9.1 llama 3 8b GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Web
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
sheep duck llama 2 70B v1.1
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
MathCoder2 CodeLlama 7B
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.2 8B GGUF 200K
Llama · prithivMLmods
Params8B
Context128K
Smallest16.1 GB
LL
Meta llama.Llama 4 Scout 17B 16E Instruct
Llama · DevQuasar-12
Params108B
Context10240K
Q4_K_M65.4 GB