Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Higgs-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
CodeLlama 7B Kexer
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
EVA LLaMA 3.33 70B v0.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama Leonida v2
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
LL
Llama 3 Yggdrasil 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Groq 8B Tool Use
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B bonito v1 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-4-Scout-17B-16E-Instruct
Llama · ggml-org
Params108B
Context10240K
Q4_K_M65.4 GB
LL
FireStorm Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Lexi-Smaug-Uncensored
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ektome_Nemotron Nano 8B
Llama · Zynerji
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · OwenArli
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct v0.4
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Artificium llama3.1 8B 001
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 70B ShiningValiant2
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3-8b-Cosmopedia-japanese
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Liberalis Cogitator Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8B Lexi Uncensored i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3.1 8B PlumMath
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 4 Scout Medical MoE Fp8 Base
Llama · mradermacher
Params108B
Context10240K
Q4_K_M65.4 GB
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Replete Coder V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama-3-gutenberg-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB