Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
LongWriter Llama3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama-3-8b-chat-doctor
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama SEA LION v2 8B IT
Llama · aisingapore
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
AMD Llama 135m
Llama · bartowski
Params134M
Context2K
Q4_K_M0.1 GB
LL
Llama 3 DARE 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Replete LLM V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
LL
ADG CoT LLaMa3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · akjindal53244
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 8B UltraLong 4M Instruct i1
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
LL
Prox-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Discoleo
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama32_1Bn_Raft_Non_Traditional_Credentials
Llama · martyyz
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Hermes 2 Pro Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
88_Llama2_32k_Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
LL
Llama 3_3 Nemotron Super 49B GenRM
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
LL
Llama 3.3 8B Stheno Mahou Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Kita258
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SmartSnap LLaMA3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Mahou 1.3 llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama TI 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-70B-Instruct-norefusal
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta Llama 3.1 Instruct 12.2B BRAINSTORM 20x FORM 8
Llama · DavidAU
Params12.2B
Context128K
Q4_K_M7.4 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · second-state
Params51.5B
Context128K
Q4_K_M31.0 GB
LL
Llama32_1Bn_Raft_Non_Traditional_Credentials_V2
Llama · tituslhy
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLama3-Lexi-Aura-3Some-SLERP-SLERP
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Sao10K/Llama-3.1-8B-Stheno-v3.4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Stheno Maid Blackroot Grand HORROR 16B
Llama · mradermacher
Params16.5B
Context8K
Q4_K_M10.0 GB