Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Storm 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-Neurona-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
Llama TI 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoning
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
GPT 5 Distill llama3.2 3B Instruct Heretic
Llama · ChiKoi7
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
llama-3-70B-Instruct-abliterated
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
AMD Llama 135m i1
Llama · mradermacher
Params134M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Reflection Llama 3.1 70B IMat
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
LL
Badger Iota Llama 3 8b Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OpenMath2 Llama3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
Roleplay
LL
Llama-3-11.5B-Instruct-Coder-v2
Llama · bartowski
Params11.5B
Context8K
Q4_K_M7.0 GB
Coding
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
EnnoAi-Pro-French-Llama-3-8B-v0.4
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama-7B-KStack-clean
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
CodeMind Llama3.1 8B unsloth merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3.1 8B Enigma
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama Spark
Llama · arcee-ai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Pruned 4 Layers LoRA PEFT 2.0 i1
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
GGUF
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Mahou-1.2a-llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMAX3-8B-Alpaca
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Ektome Llama 3.1 8B PristinelyUncensored
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct_Abliterated
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Turkish
Llama · mradermacher
Params8.1B
Context128K
Q4_K_M5.0 GB
GGUF
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing