Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.1 8B toxic dpo NoWarning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball Llama 3.1 8B Philos Relection
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 ELYZA JP 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · second-state
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · Lewdiculous
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · gaianet
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Reflection Llama 3.1 70B
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3-Instruct-8B-SimPO-ExPO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLaMA 2 13b GTL Delta
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama2 12.8b_lora Dpo_V1
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
Truthfulqa Truth Judge Llama2 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.2 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama Nemotron Embed 1b v2
Llama · mykor
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
ArliAI Llama 3 8B Formax v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
ELYZA-japanese-Llama-2-7b-fast
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
LL
Llama 3.1 8B TitanFusion v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2 1B SelfHelp Full
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Explore_Llama 3.1 8B Inst
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Dolphin3.0 Llama3.1 8B Abliterated
Llama · G4E-Unknown
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA 3 8B SFR SFT R i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Petro Instruct v1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Taiwan LLaMa v0.0
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama-3-Deppressed-Therapist-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-notHumpback-M1-Rw-F-8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8b ita ties pro i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Tulu 3.1 8B SuperNova
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 Med42 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-80K-QLoRA-Merged
Llama · mradermacher
Params8.03B
Context80K
Q4_K_M4.9 GB
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Gemma 2 Llama Swallow 2b It v0.1 Heretic
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB