Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
llama-3-Nephilim-v3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Urdu Llama 3.2 3B Instruct v1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LL
3 Goldfish Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 3.2 1B Instruct heretic
Llama · Green-Eye
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
AIML GEEK prompt finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
MFANN Llama3.1 Abliterated SLERP TIES V3 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Nomad LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Bagel Hermes 2 Pro Llama3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Kancil-V1-llama3-fp16
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CoSER Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama_8B_Explainer
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
cais HarmBench Llama 2 13b cls
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2.1 Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama Phishsense 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama medx v0 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLama 3.1 8b Ultra Max Pro i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Swallow 70B v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
MAGIC Llama3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
STAIR Llama 3.1 8B SFT i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Josiefied Llama 3.2 1B Instruct Abliterated v1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
laislemke LLaMA 2 vicuna 7b slerp
Llama · RichardErkhov
Params6.74B
Context32K
Q4_K_M0.6 GB
GGUF
LL
Evolved Llama3 ELYZA Uncensored 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 KafkaLM 8B v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Nvidia ChatQA 1.5 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Galen-8B-32k-v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Gigi Llama3 8B Chinese zh
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Instruct.immunized.v2
Llama · ApolloRaines
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Roleplay-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
ArliAI-Llama-3-8B-Cumulus-v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing