Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Ichigo llama3.1 s base v0.3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Standard Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 3.1 11b pretrained i1
Llama · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
LL
MaziyarPanahi calme 2.2 llama3 70b
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LongWriter Llama3.1 8B Absolute Heresy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-120B-Instruct
Llama · bartowski
Params122B
Context8K
Q4_K_M73.2 GB
LL
DigitalForensicsText2SQLite
Llama · pawlaszc
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama3 stanford encyclopedia philosophy QA i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · failspy
Params70.6B
Context8K
Smallest34.3 GB
LL
LLMBG Llama 3.1 8B BG Reasoning v0.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 8B Fireplace2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Negative_LLAMA_70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
SOVL_Llama3_8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Dobby Mini Unhinged Plus Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Pruned 4 Layers LoRA PEFT 2.0
Llama · mradermacher
Params6.94B
Context128K
Q4_K_M4.3 GB
LL
codellama_codellama-7b-instruct-hf
Llama · DevShubham
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.2 1B Intruct Tool Calling V2
Llama · nguyenthanhthuan
Params1.24B
Context128K
Smallest1.3 GB
LL
Sheared LLaMA 1.3B
Llama · Aryanne
Params1.35B
Context4K
Smallest0.8 GB
LL
llama-3-cat-8b-instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-WizardLM-196K
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
openbuddy_openbuddy-llama2-13b64k-v15
Llama · TheBloke
Params13.1B
Context64K
Q4_K_M7.9 GB
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · LWDCLS
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 10b It Kor Extented Chang
Llama · RichardErkhov
Params9.78B
Context8K
Q4_K_M6.0 GB
LL
Llama 3.1 8B XGuard Merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 2 13b Lemon Alpaca
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · mradermacher
Params8.03B
Context10K
Q4_K_M4.9 GB