Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama Guard 3 1B
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.10
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
llava llama 3 8b v1 1 GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
LL
MultiPL-T-CodeLlama_34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Dorna Llama3 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
CodeLlama 13B Instruct
Llama · second-state
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama3 Med42 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3 Youko 70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 Storm 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LL
dolphin-2.9-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama EveningMirai 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama2.C stories15M
Llama · mradermacher
Params24M
Context256
Q4_K_M0.0 GB
LL
calme-2.2-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nvidia Llama3 ChatQA 1.5 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLaMA2 13B Psyfighter2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.2 1B Instruct heretic
Llama · saidutta69
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.9
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
LL
LLaMAntino 2 7b Hf ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.1 EIRAI 8B Prob i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
OpenBioLLM Llama3 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Artificium llama3.1 8B 001
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
LLaMA3 iterative DPO final
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
calme 2.4 llama3 70b i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB