Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B StructuredIE v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Fusion 7030
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CoT llama 2k 7b i1
Llama · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
GGUF
LL
Mahou-1.2-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Doppleganger V5a LLaMa 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3.1-8B-sft-SPIN-human-dataset
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Instruct Ortho v3
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama1 3b
Llama · Elchikibaby
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 SUN 2.5B Chat
Llama · mradermacher
Params2.47B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
LL
Llama3 ChatQA 2 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3.1 70B lumitron i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Linkbricks-Horizon-AI-Korean-llama31-sft-dpo-8B
Llama · Saxo
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Experiment v1 9B
Llama · mradermacher
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
LL
Vijendra CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
LA Llama
Llama · ibrahimBlyc
Params3.21B
Context128K
Smallest6.4 GB
Tool use
LL
Llama-3-Perky-Pat-Instruct-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI Llama 3 8B Dolfin v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
calme-3.1-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 1 Million Ctx DeepHermes Deep Reasoning 8B
Llama · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama3 42b v0 imat
Llama · NyxKrage
Params43.2B
Context8K
Q4_K_M26.1 GB
GGUF
LL
liberalis-cogitator-llama-3.1-8b-dpo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 8B SmileyLlama 1.1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama-3-stella-truthy-dpo-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · redponike
Params4.51B
Context128K
Q4_K_M2.8 GB
Tool use
LL
Llama-3-Swallow-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
hermes llama3 roleplay 4000 v4 i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
RealGuardrails Llama3.1 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama-3-8B-rpg-v4
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-8B-programming-questions-v2.2-merge
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
meta-llama/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing