Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B toxic dpo NoWarning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Fireball Llama 3.1 8B Philos Relection
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 ELYZA JP 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · second-state
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · Lewdiculous
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.2 3B Instruct
Llama · gaianet
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Reflection Llama 3.1 70B
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3-Instruct-8B-SimPO-ExPO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA 2 13b GTL Delta
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama2 12.8b_lora Dpo_V1
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Truthfulqa Truth Judge Llama2 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.2 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama Nemotron Embed 1b v2
Llama · mykor
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
LL
ArliAI Llama 3 8B Formax v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b-fast
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 3.1 8B TitanFusion v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2 1B SelfHelp Full
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Explore_Llama 3.1 8B Inst
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Dolphin3.0 Llama3.1 8B Abliterated
Llama · G4E-Unknown
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA 3 8B SFR SFT R i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Petro Instruct v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Taiwan LLaMa v0.0
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Deppressed-Therapist-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-notHumpback-M1-Rw-F-8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8b ita ties pro i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Tulu 3.1 8B SuperNova
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3 Med42 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-80K-QLoRA-Merged
Llama · mradermacher
Params8.03B
Context80K
Q4_K_M4.9 GB
GGUF
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Gemma 2 Llama Swallow 2b It v0.1 Heretic
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing