Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Unichat llama3 Chinese 8B
Llama · Monor
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-70b-Arimas-story-RP-V1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.3 Argunaut 1 70B SFT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · gaianet
Params51.5B
Context128K
Q4_K_M31.0 GB
LL
TxAgent T1 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Genius_Magpie 25K_LLaMA3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
leap llm Meta Llama 3 8B Instruct sft alfworld iter2
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
omed llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct AgenticLU
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Papy_2_Llama 3.1 8B Instruct_text
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ArrowCanaria Llama 8B RL v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Exam Generator Llama3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama guard quant
Llama · tybrs
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 1B
Llama · DevQuasar-3
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
smol llama 220M bees internal
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
LL
Med-LLaMA3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Scarlett-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Mini Lama 8B Base
Llama · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
LL
Llama-3.2-1B-Instruct
Llama · RekcyDecky
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Awanllm-Llama-3-8B-Instruct-DPO-v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Tesser-Llama-3-Ko-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
prometheus-2-llama-3-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B GRA Condor
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 Krix v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Ichigo Llama3.1 8B v0.5
Llama · mradermacher
Params8.05B
Context128K
Q4_K_M4.9 GB
LL
Llama Poro 2 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 4 Scout 17B 6E Instruct
Llama · mradermacher
Params47.4B
Context10240K
Q4_K_M28.8 GB
LL
Llama 3 70B UltraMedical
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Holgerim Llama 7b i1
Llama · mradermacher
Params6.54B
Context4K
Q4_K_M4.0 GB
LL
Legion V2.1 LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB