Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Stylizer V2 LLaMa 70B Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.2 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 8B Instruct MedQA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Self Certainty Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
LL
Llama 3 8B Instruct Portuguese v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3.1-Argunaut-1-8B-SPIN
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
LL
Bllossom70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview imatrix
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
WorldModel Stabletoolbench Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3 stinky v2 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Fetishist V5 LLaMA 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
svd safety l3 swift remove50 swapgapiter b010
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
smol_llama-220M-GQA-fineweb_edu
Llama · RichardErkhov
Params218M
Context2K
Q4_K_M0.1 GB
GGUF
LL
YouToks Instruct Quantum Physics II Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8B Fusion 5050
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Korean 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
formapproval llama 8b WEbLINX ft WebLINX v2 vllm
Llama · RichardErkhov
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
LL
mlfoundations dev hp ablations llama3 epoch2 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
badger lambda llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hermes 2 Pro Llama 3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Openbuddy Llama3.1 8b v22.1 131k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
kubeguru llama3.2 3b v0.1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
RoleplayTool use
LL
Watcher V1 LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.x 70b Smarteaz V1 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
llama 3 8B Psychotherapist.v2 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct DB Expert
Llama · mradermacher
Params8.03B
Context4K
Q4_K_M4.9 GB
GGUF
LL
llama-3-8b-samantha
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing