Lite GGUF models

92 GGUF models in the Lite family, quantized by 39 uploaders. Sizes run from 64M to 22.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LI
2x lite Q4 K M
Lite · ozone-research
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LI
Lite Oute 1 65M
Lite · QuantFactory
Params65M
Context2K
Q4_K_M0.0 GB
GGUF

Keep browsing