Llama GGUF models
30050 GGUF models in the Llama family, quantized by 7365 uploaders. Sizes run from 1M to 1020B parameters. The longest trained context is 102400K tokens.
LL
Llamas Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Nous Hermes Llama2 70b
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
llama 3 8b gpt 4o ru1.0
Llama · ruslandev
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Regulus Qwen3 R1 Llama Distill 1.7B
Llama · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
LL
Llama-3-Refueled
Llama · thesven
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Hazy Llama 70b i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Qwen3.8 Flash Next Uncensored ik llama v4 lite iq3 kt
Llama · Amarillys
Params177B
Context256K
Smallest80.0 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama EveningMirai Moonwalker MS 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Swallow 8B v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Opencsg codeLlama 7b v0.2
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Fireball Alpaca Llama3.1 8B Philos
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
GRAM RR LLaMA 3.1 8B RewardModel
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-2.2-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
LL
Llama Llava Medtrinity
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
yayi2 30B llama
Llama · TheBloke
Params30.4B
Context4K
Q4_K_M18.2 GB
LL
llama-3-8b-gpt-4o
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Collaiborator-MEDLLM-Llama-3-8B-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Instruct 262k
Llama · QuantFactory
Params8.03B
Context256K
Q4_K_M4.9 GB
LL
shisa v1 llama3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 8b Moroccan
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 2 7b chat sexed version5 i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Reasoning Llama 3.2 1B Instruct v1.2 i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Dolphin 3.0 Llama 3.2 1b
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB