GGUF models: llama3.2 license

2449 GGUF models listed under the llama3.2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 18.4B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 3B Instruct
Llama · Solshine
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
AXCXEPT EZO Llama 3.2 3B Instruct dpoE
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 3B Instruct Lyrics
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
Llama 3.2 3b
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
llama3.2 typhoon2 3b instruct
Llama · Float16-cloud
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 3B Gundem LoRA
Llama · efebaykara
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
SA
Sage Reasoning 14b
Sage · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
BE
besimray miner id 1 56d9075c cf98 498b 8ad6 84bc66fb6ee2 1729801843
Besimray · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
PR
Prototype Virus.FINAL 3.2 1B
Prototype · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
LL
Llama 3.2 1B It Chinese Kyara
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · aashish1904
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
HermesMarkle Valiant 3B i1
Hermesmarkle · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
OC
OctoThinker 8B Short Base
Octothinker · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · velyan
Params1.24B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.2 1B
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
Cocktail Llama
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama-3.2-3B-Instruct
Llama · goingmerry91
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
IT
Italia-GPT 🇮🇹
Italia · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3.2 3B Instruct Base
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
BA
Bad_Alice Refined RP 3.2 1B
Bad · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
LL
Alpindale Llama 3.2 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
LL
taylorj94/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.2 3B
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
VA
VaidhLLaMA 3.2 3B Instruct
Vaidhllama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
OR
orca mini v9 5 3B Instruct i1
Orca · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
MI
Mini Think Base 1B
Mini · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
BE
Bella Bartender 1b
Bella · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Models Meta Llama Llama Guard 3 1B
Llama · MaziyarPanahi
Params1.5B
Context128K
Smallest1.1 GB
GGUF
SC
Models Inference Net Schematron 3B
Schematron · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing