GGUF models: llama3.2 license

2449 GGUF models listed under the llama3.2 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 18.4B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1B Instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
Llama 3.2 3B
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
GGUF
LL
Llama 3.2 1B be
Llama · VyoJ
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MA
Magnum 1b Short Stories Q5 K M
Magnum · Novaciano
Params1.5B
Context128K
Smallest1.1 GB
GGUF
MA
Magnum 1b Short Stories IQ4 XS
Magnum · Novaciano
Params1.5B
Context128K
Smallest0.9 GB
GGUF
EV
EvoNet 3B Reasoning
Evonet · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
Llama 3.2 SUN 2.5B chat
Llama · meditsolutions
Params2.47B
Context128K
Smallest2.6 GB
ReasoningTool use
BE
besimray miner id 3 56d9075c cf98 498b 8ad6 84bc66fb6ee2 1729801842
Besimray · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · lilalola
Params1.24B
Context128K
Smallest0.9 GB
Tool use
LL
Llama 3.2 3b Shark 0.0
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
CA
Capybara_Sex 3.2 1B
Capybara · Novaciano
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
llama3.2 typhoon2 3b
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
ofin model
Llama · olamide226
Params3.21B
Context128K
Smallest2.0 GB
Tool use
LL
Llama 3.2 3B Instruct Frog
Llama · phamhai
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · 1bit-MONSTER
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama v1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Ft Smoke Jepa
Llama · renaudb1999
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Vikhr-Llama-3.2-1B-Instruct-abliterated
Llama · amtk
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
Llama 3.2 1B Tele It
Llama · ka-oh
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.2 SARA 3b
Llama · EryriLabs
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · forkjoin-ai
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 3b Instruct Bnb 4bit
Llama · TimeLInk
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
Cogito v1 Preview Llama 3B
Llama · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct
Llama · alices2
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3.2 1B
Llama · YongdongWang
Params1.24B
Context128K
Smallest0.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · kolosal
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
CodingTool use
LL
maluk whatsapp
Llama · smaluk
Params3.21B
Context128K
Smallest6.4 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · JustineF
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · jagan546
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use

Keep browsing