Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Unichat llama3 Chinese 8B
Llama · Monor
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-70b-Arimas-story-RP-V1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3.3 Argunaut 1 70B SFT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama 3_1 Nemotron 51B Instruct
Llama · gaianet
Params51.5B
Context128K
Q4_K_M31.0 GB
CodingTool use
LL
TxAgent T1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Genius_Magpie 25K_LLaMA3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
leap llm Meta Llama 3 8B Instruct sft alfworld iter2
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
omed llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct AgenticLU
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Papy_2_Llama 3.1 8B Instruct_text
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
ArrowCanaria Llama 8B RL v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Exam Generator Llama3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama guard quant
Llama · tybrs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B
Llama · DevQuasar-3
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
smol llama 220M bees internal
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Med-LLaMA3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Scarlett-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Mini Lama 8B Base
Llama · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
LL
Llama-3.2-1B-Instruct
Llama · RekcyDecky
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Awanllm-Llama-3-8B-Instruct-DPO-v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Tesser-Llama-3-Ko-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
prometheus-2-llama-3-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B GRA Condor
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 Krix v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Ichigo Llama3.1 8B v0.5
Llama · mradermacher
Params8.05B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Poro 2 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 4 Scout 17B 6E Instruct
Llama · mradermacher
Params47.4B
Context10240K
Q4_K_M28.8 GB
Tool use
LL
Llama 3 70B UltraMedical
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Holgerim Llama 7b i1
Llama · mradermacher
Params6.54B
Context4K
Q4_K_M4.0 GB
GGUF
LL
Legion V2.1 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing