Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
CleverBoi Llama 3.1 8B Instruct
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 gutenberg 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama 70B Esper i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
TinyStories LLaMA2 20M 256h 4l GQA
Llama · mradermacher
Params20M
Context2K
Q4_K_M0.0 GB
LL
Llama 3.3 Nemotron 70B Reward Principle
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Vikhr-Llama-3.2-1B-instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Smaug-Llama-3-70B-Instruct-abliterated-v3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
llama32 1b llm abliteration
Llama · muhammadrafifatihulihsan
Params1.5B
Context128K
Smallest3.0 GB
LL
Llama 3.1 8B OmniMatrix i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Tulu 2 70b
Llama · mradermacher
Params70.6B
Context2K
Q4_K_M42.5 GB
LL
OpenBioLLM Llama3 8B
Llama · aaditya
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Umbral-Mind-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 EstLLM 8B 0525
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Danoia
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Minitron 4B Magpie SFT 650K MT
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Cat-Llama-3-70B-instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama3.2 3B Claude Reasoning Distill
Llama · codestrate
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Open Insurance LLM Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama31 eros i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
selfrag llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
DAT Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3 8B DarkIdol 2.3 Uncensored 32K GGUF IQ Imatrix Request
Llama · LWDCLS
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CleverBoi Llama 3.2 3B Instruct
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Phind CodeLlama 34B v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Llama3.1 8B Cobalt
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 70B Instruct Abliterated v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Ichigo llama3.1 s instruct v0.3 phase 3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Gemma 2 Llama Swallow 27b It v0.1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB