Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
llama-3-Nephilim-v3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Urdu Llama 3.2 3B Instruct v1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
3 Goldfish Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 3.2 1B Instruct heretic
Llama · Green-Eye
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
AIML GEEK prompt finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Nomad LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Bagel Hermes 2 Pro Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Kancil-V1-llama3-fp16
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
CoSER Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama_8B_Explainer
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
cais HarmBench Llama 2 13b cls
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama3 8b Cpt Sea Lionv2.1 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Phishsense 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama medx v0 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLama 3.1 8b Ultra Max Pro i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Swallow 70B v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
MAGIC Llama3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
STAIR Llama 3.1 8B SFT i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Josiefied Llama 3.2 1B Instruct Abliterated v1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
laislemke LLaMA 2 vicuna 7b slerp
Llama · RichardErkhov
Params6.74B
Context32K
Q4_K_M0.6 GB
LL
Evolved Llama3 ELYZA Uncensored 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 KafkaLM 8B v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Nvidia ChatQA 1.5 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Galen-8B-32k-v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Gigi Llama3 8B Chinese zh
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct.immunized.v2
Llama · ApolloRaines
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Roleplay-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ArliAI-Llama-3-8B-Cumulus-v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB