Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.1 Storm 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Instruct-Neurona-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama TI 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
GPT 5 Distill llama3.2 3B Instruct Heretic
Llama · ChiKoi7
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
llama-3-70B-Instruct-abliterated
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
AMD Llama 135m i1
Llama · mradermacher
Params134M
Context2K
Q4_K_M0.1 GB
LL
Reflection Llama 3.1 70B IMat
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
LL
Badger Iota Llama 3 8b Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OpenMath2 Llama3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
LL
Llama-3-11.5B-Instruct-Coder-v2
Llama · bartowski
Params11.5B
Context8K
Q4_K_M7.0 GB
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
EnnoAi-Pro-French-Llama-3-8B-v0.4
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
CodeLlama-7B-KStack-clean
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeMind Llama3.1 8B unsloth merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Enigma
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama Spark
Llama · arcee-ai
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Pruned 4 Layers LoRA PEFT 2.0 i1
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Mahou-1.2a-llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
LLaMAX3-8B-Alpaca
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Ektome Llama 3.1 8B PristinelyUncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct_Abliterated
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Turkish
Llama · mradermacher
Params8.1B
Context128K
Q4_K_M5.0 GB
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB