Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
harborwater_open-llama-3b-v2-wizard-evol-instuct-v2-196k
Llama · TheBloke
Params3.43B
Context2K
Q4_K_M2.6 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
LL
ehartford_wizardlm-1.0-uncensored-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
tulu v1 llama2 70b i1
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
LL
Llama-3_3-Nemotron-Super-49B-V1_5
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
LL
calme 2.2 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
LL
LLaMA2 13B Tiefighter i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
LL
Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
ShiningValiantXS 1.1
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
dolphin-2.9.1-llama-3-8b
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
LL
phind_phind-codellama-34b-v1
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
georgesung_llama2_7b_chat_uncensored
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · mlabonne
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 7B rollercoaster v2 i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Akikawa 3.3 1b Roleplay 128K
Llama · Green-Eye
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
bangla-llama-7b-instruct-v0.1
Llama · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
LL
Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3.3 70B Instruct ablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llava v1.5 7b llamafile
Llama · mozilla-ai
Params6.74B
Context4K
Smallest4.1 GB
LL
Llama 3.2 3B Instruct
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
llama 65b instruct i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
LL
togethercomputer_llama-2-7b-32k-instruct
Llama · TheBloke
Params6.74B
Context32K
Q4_K_M4.1 GB
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
openassistant_llama2-13b-orca-8k-3319
Llama · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
LL
ehartford_samantha-1.11-codellama-34b
Llama · TheBloke
Params33.7B
Context2K
Q4_K_M20.2 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB