Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3 OffsetBias 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Small Llama3 6B
Llama · ukung
Params6.29B
Context8K
Q4_K_M3.9 GB
LL
LongWriter Llama3.1 8b Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Pruned 3 Layers
Llama · mradermacher
Params7.16B
Context128K
Q4_K_M4.4 GB
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Travelplanner SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Code-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Discord Short 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B Instruct
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8B Instruct Gradient 1048k i1
Llama · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
Llama 3 8B Magpie Pro SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Unsafe Llama 3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B DPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.1 airoboros3.2 QDT 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Tulu v2.5 8b Uf Mean 70b Uf Rm Mixed Prompts
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
civic-ai-llama
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct 24 9 29
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
openbuddy llama2 70B v13 base
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
LL
Llama 3.1 70B Heretic Lora
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama-3-youko-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Cat-Llama-3-70B-instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
llama 3 zilo sql
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B BookAdventures
Llama · KoboldAI
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B SFT
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama PLLuM 70B Chat 2412
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 Instruct 8B SPPO Iter3 imatrix
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Lexi Uncensored
Llama · Andycurrent
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Yi 6B 200K Llama
Llama · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
LL
LlamaScientific 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB