Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.2 1B Instruct
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Unichat llama3 Chinese 8B 28K
Llama · Monor
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
dolphin 2.9 llama3 8b
Llama · foxtail2
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
frankencria llama2 12.5b v1.3 m.2 i1
Llama · mradermacher
Params12.4B
Context4K
Q4_K_M7.5 GB
LL
Meta Llama Llama 3.2 3B Instruct
Llama · aashish1904
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
llama 3.2 3b programming lab
Llama · Neha-Kore45
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
pub llama 13B v6 i1
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Aleph 2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AMD Llama 135m code
Llama · bartowski
Params134M
Context2K
Q4_K_M0.1 GB
LL
Llama 3.1 SuperNova 8B Lite_TIES_with_Base Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
saqada Llama 3.1 8B with 16bit merged lora adapters MOV v7
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AkaLlama llama3 70b v0.1
Llama · snupilab
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 13B Instruct Abliterated
Llama · mradermacher
Params13.3B
Context128K
Q4_K_M8.1 GB
LL
LLaMA3 iterative DPO final
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
RolePlayer V5 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8B Lexi Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
RLHFlow LLaMA3 iterative DPO final
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 KafkaLM 8B v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLaMAntino 2 Chat 7b Hf UltraChat ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.1 SuperNova Lite Lorabilterated 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1b
Llama · ElementMerc
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Linkbricks Horizon AI Korean Advanced 8B
Llama · Saxo
Params8.03B
Context128K
Smallest4.9 GB
LL
GRAM RR LLaMA 3.2 3B RewardModel
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
GRAM LLaMA3.2 3B RewardModel
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
OneLLM Doey V1 Llama 3.2 1B it
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama-3-8B-Synthia-v3.5
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B dutch
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B SPPO Iter3 SimPO Merge
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB