Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.1 8B Instruct Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama 7b Instruct Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct absolute heresy i1
Llama · mradermacher
Params8B
Context1048K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Alif 1.0 8B Instruct
Llama · large-traversaal
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3_3-Nemotron-Super-49B-V1
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
LL
llama 65b hf i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
LL
LLaMA2 13B Tiefighter
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · Hasaranga85
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Tiamat 8b 1.2 Llama 3 DPO i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
CodeLlama 7B KStack clean
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama-3-Luminurse-v0.1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
yeen214_llama2_7b_merge_orcafamily
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
CodeLlama 7b CypherGen
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.2 GB
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
LL
Llama 3.1 8B MultiReflection Instruct i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2 3B Explained
Llama · theprint
Params3.2B
Context128K
Q4_K_M2.0 GB
LL
Llama2 7B Hindi finetuned
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Hermes-2-Theta-Llama-3-8B-32k
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
LL
dolphin-2.9.1-llama-3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
deepthought 8b llama v0.01 alpha
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3.3-8B-Instruct
Llama · Mungert
Params8B
Context8K
Q4_K_M5.3 GB
LL
llama2 7b chat uncensored i1
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Llama3 DocChat 1.0 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB