Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llama 3.1 8B StructuredIE v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Fusion 7030
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CoT llama 2k 7b i1
Llama · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
LL
Mahou-1.2-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Doppleganger V5a LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3.1-8B-sft-SPIN-human-dataset
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8b Instruct Ortho v3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama1 3b
Llama · Elchikibaby
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.2 SUN 2.5B Chat
Llama · mradermacher
Params2.47B
Context128K
Q4_K_M1.5 GB
LL
Llama3 ChatQA 2 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.1 70B lumitron i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Linkbricks-Horizon-AI-Korean-llama31-sft-dpo-8B
Llama · Saxo
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Experiment v1 9B
Llama · mradermacher
Params8.9B
Context8K
Q4_K_M5.4 GB
LL
Vijendra CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
LA Llama
Llama · ibrahimBlyc
Params3.21B
Context128K
Smallest6.4 GB
LL
Llama-3-Perky-Pat-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ArliAI Llama 3 8B Dolfin v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
calme-3.1-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 1 Million Ctx DeepHermes Deep Reasoning 8B
Llama · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
LL
llama3 42b v0 imat
Llama · NyxKrage
Params43.2B
Context8K
Q4_K_M26.1 GB
LL
liberalis-cogitator-llama-3.1-8b-dpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B SmileyLlama 1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama-3-stella-truthy-dpo-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · redponike
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Llama-3-Swallow-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
hermes llama3 roleplay 4000 v4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
RealGuardrails Llama3.1 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama-3-8B-rpg-v4
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-8B-programming-questions-v2.2-merge
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
meta-llama/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB