Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
LongWriter Llama3.1 8b
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama-3-8b-chat-doctor
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama SEA LION v2 8B IT
Llama · aisingapore
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
AMD Llama 135m
Llama · bartowski
Params134M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Llama 3 DARE 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Replete LLM V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
GGUF
LL
ADG CoT LLaMa3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · akjindal53244
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 Nemotron 8B UltraLong 4M Instruct i1
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
Tool use
LL
Prox-Llama-3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Discoleo
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama32_1Bn_Raft_Non_Traditional_Credentials
Llama · martyyz
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Hermes 2 Pro Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LL
88_Llama2_32k_Instruct
Llama · mradermacher
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
LL
Llama 3_3 Nemotron Super 49B GenRM
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
LL
Llama 3.3 8B Stheno Mahou Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · Kita258
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
SmartSnap LLaMA3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Mahou 1.3 llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama TI 8B Instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoningTool use
LL
Llama-3-70B-Instruct-norefusal
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta Llama 3.1 Instruct 12.2B BRAINSTORM 20x FORM 8
Llama · DavidAU
Params12.2B
Context128K
Q4_K_M7.4 GB
RoleplayTool use
LL
Llama 3_1 Nemotron 51B Instruct
Llama · second-state
Params51.5B
Context128K
Q4_K_M31.0 GB
CodingTool use
LL
Llama32_1Bn_Raft_Non_Traditional_Credentials_V2
Llama · tituslhy
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
LLama3-Lexi-Aura-3Some-SLERP-SLERP
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Sao10K/Llama-3.1-8B-Stheno-v3.4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Stheno Maid Blackroot Grand HORROR 16B
Llama · mradermacher
Params16.5B
Context8K
Q4_K_M10.0 GB
Roleplay

Keep browsing