Llama GGUF models

30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llamas Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Nous Hermes Llama2 70b
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
LL
llama 3 8b gpt 4o ru1.0
Llama · ruslandev
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Regulus Qwen3 R1 Llama Distill 1.7B
Llama · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama-3-Refueled
Llama · thesven
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Hazy Llama 70b i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Qwen3.8 Flash Next Uncensored ik llama v4 lite iq3 kt
Llama · Amarillys
Params177B
Context256K
Smallest80.0 GB
ReasoningTool use
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama EveningMirai Moonwalker MS 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Hermes-2-Theta-Llama-3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Swallow 8B v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Opencsg codeLlama 7b v0.2
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Fireball Alpaca Llama3.1 8B Philos
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
GRAM RR LLaMA 3.1 8B RewardModel
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama3-8B-DarkIdol-2.2-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
Roleplay
LL
Llama Llava Medtrinity
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Vision
LL
yayi2 30B llama
Llama · TheBloke
Params30.4B
Context4K
Q4_K_M18.2 GB
GGUF
LL
llama-3-8b-gpt-4o
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Collaiborator-MEDLLM-Llama-3-8B-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct 262k
Llama · QuantFactory
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
shisa v1 llama3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8b Moroccan
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 2 7b chat sexed version5 i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Reasoning Llama 3.2 1B Instruct v1.2 i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
LL
Dolphin 3.0 Llama 3.2 1b
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use

Keep browsing