Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
MFANN Llama3.1 Abliterated SLERP V4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 Taiwan 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct Coding Expert
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 1B
Llama · mradermacher
Params1.72B
Context128K
Q4_K_M1.1 GB
LL
Hacker News Comments Summarization Llama 3.1 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Uncensored Dare
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ichigo llama3.1 s instruct v0.4
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8b Dolphin Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
PULI LlumiX Llama 3.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llama-3-typhoon-v1.5-8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Turkish-Llama-8b-Instruct-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 PeanutButter v19 R8 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Esmeralda Llama 3.1 8B Control
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-70B-Instruct
Llama · qwp4w3hyb
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Infinity-Instruct-3M-0613-Llama3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama Breeze2 8B Instruct Text Only
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct.immunized.v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct
Llama · medmekk
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama-3-SauerkrautLM-8b-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Latxa Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B OmniMatrix
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball Llama 3.11 8B v1orpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMAntino 3 ANITA 8B Inst DPO ITA
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B ClauseLM
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB