Lite GGUF models
92 GGUF models in the Lite family, quantized by 39 uploaders. Sizes run from 64M to 22.2B parameters. The longest trained context is 256K tokens.
LI
T Lite It 1.0
Lite · Egor-3926
Params7.61B
Context32K
Smallest8.1 GB
LI
Lite Cydonia 22B v1.1
Lite · knifeayumu
Params22.2B
Context32K
Q4_K_M13.3 GB
LI
T Lite Instruct 0.1
Lite · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
Lite Oute 1 65M
Lite · RichardErkhov
Params65M
Context2K
Q4_K_M0.0 GB
LI
Lite Oute 1 300M
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
LI
Cydonia 22B v1.1
Lite · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
LI
Lite Oute 1 65M Instruct
Lite · RichardErkhov
Params65M
Context2K
Q4_K_M0.0 GB
LI
Lite-Oute-1-300M
Lite · OuteAI
Params300M
Context4K
Q4_K_M0.2 GB
LI
AnatoliiPotapov/T-lite-0.1
Lite · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
T Lite Instruct 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LI
Lite Oute 1 300M
Lite · RichardErkhov
Params300M
Context4K
Q4_K_M0.2 GB
LI
Atlas nms v2
Lite · Knixee
Params8.19B
Context40K
Q4_K_M5.0 GB
LI
Lite Oute 1 65M
Lite · mradermacher
Params65M
Context2K
Q4_K_M0.0 GB
LI
T Lite It 1.0 Quants
Lite · DefaultDF
Params7.61B
Context32K
Smallest3.5 GB
LI
Lite Oute 1 300M Instruct
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
LI
Lite Oute 1 300M Instruct
Lite · mradermacher
Params300M
Context4K
Q4_K_M0.2 GB
LI
T lite it 2.1 abl
Lite · smkrv
Params8.19B
Context40K
Q4_K_M5.0 GB
LI
Lite Cydonia 22B v1.1
Lite · knifeayumu
Params22.2B
Context128K
Q4_K_M13.3 GB
LI
AnatoliiPotapov T Lite Instruct 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LI
Lite-Oute-1-65M-smol-smoltalk
Lite · mradermacher
Params64M
Context2K
Q4_K_M0.0 GB
LI
T lite it 1.0
Lite · tmplife
Params7.61B
Context32K
Smallest3.6 GB
LI
T lite it 1.0 Q8 0
Lite · t-tech
Params7.61B
Context32K
Smallest8.1 GB
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
T Lite Instruct 0.1
Lite · AlekseyElygin
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
K2 Lite 1.7B
Lite · mradermacher
Params2.03B
Context128K
Q4_K_M1.3 GB
LI
agmind rag splitter ru
Lite · AGmind
Params8.19B
Context40K
Smallest5.9 GB
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Smallest5.7 GB
LI
Lite Cydonia 22B v1.1 50 50
Lite · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
LI
Lite Oute 1 65M Instruct
Lite · QuantFactory
Params65M
Context2K
Q4_K_M0.0 GB
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Smallest8.5 GB