Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Ornith 1.0 35B
Llama · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
chargoddard llama 2 26b trenchcoat stack
Llama · RichardErkhov
Params25.7B
Context—
Q4_K_M5.5 GB
LL
Llama 2 70B Orca 200k
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
codellama_codellama-70b-hf
Llama · TheBloke
Params69B
Context16K
Q4_K_M41.4 GB
LL
Llama 2 7b chat hf function calling v2
Llama · Trelis
Params7B
Context—
Smallest0.0 GB
LL
llava llama 3 8b v1 1 imat
Llama · city96
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 8B Thinking Gemini Flash 11000x 128k
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
models--mergekit-community--Llama3-12B-wwe
Llama · MaziyarPanahi
Params13.7B
Context8K
Q4_K_M8.3 GB
LL
CodeLlama 7b Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
LL
Emma 500 Llama2 7b
Llama · bartowski
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 2 13B Chat Dutch
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 Meerkat 8b v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Humanish Roleplay Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Firefly Llama2 13B v1.2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 2 13B Ensemble v6
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.2 1B Instruct
Llama · gaianet
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
nvidia Llama 3 3 Nemotron Super 49B v1
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
LL
Llama-3-8B-Instruct-MopeyMule
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB