Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Stylizer V2 LLaMa 70B Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.2 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.1 8B Instruct MedQA
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Self Certainty Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Llama 3 8B Instruct Portuguese v0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3.1-Argunaut-1-8B-SPIN
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
LL
Bllossom70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
DeepHermes 3 Llama 3 8B Preview imatrix
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
WorldModel Stabletoolbench Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3 stinky v2 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Fetishist V5 LLaMA 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
svd safety l3 swift remove50 swapgapiter b010
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
smol_llama-220M-GQA-fineweb_edu
Llama · RichardErkhov
Params218M
Context2K
Q4_K_M0.1 GB
LL
YouToks Instruct Quantum Physics II Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 8B Fusion 5050
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Korean 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
formapproval llama 8b WEbLINX ft WebLINX v2 vllm
Llama · RichardErkhov
Params2.7B
Context4K
Q4_K_M1.6 GB
LL
mlfoundations dev hp ablations llama3 epoch2 dcftv1.2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
badger lambda llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Hermes 2 Pro Llama 3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Openbuddy Llama3.1 8b v22.1 131k
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
kubeguru llama3.2 3b v0.1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.2 1B Instruct
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Watcher V1 LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.x 70b Smarteaz V1 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama 3 8B Psychotherapist.v2 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct DB Expert
Llama · mradermacher
Params8.03B
Context4K
Q4_K_M4.9 GB
LL
llama-3-8b-samantha
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB