Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
chinese llama 2 7b 64k
Llama · hfl
Params6.93B
Context64K
Smallest2.6 GB
LL
Llama 2 7b Chat Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
YBXL Med LLaMA3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SlimOrca Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Deep Reasoning Llama 3.2 Instruct uncensored 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Asclepius-Llama2-13B
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LL
Hermes 3 Llama 3.2 3B Q4 K M
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
WiNGPT2 Llama 3 8B Base
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
openbuddy llama3.1 8b v22.3 131k i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 70b Reward Model Biases Merged
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Fireball R1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMAX3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Cogito v2 Preview Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
CodeLlama-7B-KStack
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3 13B
Llama · mradermacher
Params13.3B
Context8K
Q4_K_M8.1 GB
LL
meta llama Llama 2 7b hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.1 Tulu 2 Dpo 70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nsql llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B Ko Reasoning
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Tulu 3 8B DPO i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama-70b-Python-hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
LL
llama 3 70B Instruct abliterated
Llama · failspy
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
meta-llama/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLama 3.1 8B Janus Abliterated V2
Llama · SOMEHOTMEAL
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1-70B-Chinese-Chat
Llama · shenzhi-wang
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
gemma 3 4b teste unloth llama.cpp
Llama · alexiaassis
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB