Lite GGUF models

92 GGUF models in the Lite family, quantized by 39 uploaders. Sizes run from 64M to 22.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LI
T Lite It 1.0
Lite · Egor-3926
Params7.61B
Context32K
Smallest8.1 GB
Reasoning
LI
Lite Cydonia 22B v1.1
Lite · knifeayumu
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
LI
T Lite Instruct 0.1
Lite · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
Lite Oute 1 65M
Lite · RichardErkhov
Params65M
Context2K
Q4_K_M0.0 GB
GGUF
LI
Lite Oute 1 300M
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
LI
Cydonia 22B v1.1
Lite · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
LI
Lite Oute 1 65M Instruct
Lite · RichardErkhov
Params65M
Context2K
Q4_K_M0.0 GB
GGUF
LI
Lite-Oute-1-300M
Lite · OuteAI
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
LI
AnatoliiPotapov/T-lite-0.1
Lite · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
T Lite Instruct 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LI
Lite Oute 1 300M
Lite · RichardErkhov
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
LI
Atlas nms v2
Lite · Knixee
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LI
Lite Oute 1 65M
Lite · mradermacher
Params65M
Context2K
Q4_K_M0.0 GB
GGUF
LI
T Lite It 1.0 Quants
Lite · DefaultDF
Params7.61B
Context32K
Smallest3.5 GB
GGUF
LI
Lite Oute 1 300M Instruct
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
LI
Lite Oute 1 300M Instruct
Lite · mradermacher
Params300M
Context4K
Q4_K_M0.2 GB
Tool use
LI
T lite it 2.1 abl
Lite · smkrv
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LI
Lite Cydonia 22B v1.1
Lite · knifeayumu
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
LI
AnatoliiPotapov T Lite Instruct 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LI
Lite-Oute-1-65M-smol-smoltalk
Lite · mradermacher
Params64M
Context2K
Q4_K_M0.0 GB
GGUF
LI
T lite it 1.0
Lite · tmplife
Params7.61B
Context32K
Smallest3.6 GB
GGUF
LI
T lite it 1.0 Q8 0
Lite · t-tech
Params7.61B
Context32K
Smallest8.1 GB
GGUF
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
T Lite Instruct 0.1
Lite · AlekseyElygin
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
K2 Lite 1.7B
Lite · mradermacher
Params2.03B
Context128K
Q4_K_M1.3 GB
ReasoningTool use
LI
agmind rag splitter ru
Lite · AGmind
Params8.19B
Context40K
Smallest5.9 GB
ReasoningTool use
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Smallest5.7 GB
GGUF
LI
Lite Cydonia 22B v1.1 50 50
Lite · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
LI
Lite Oute 1 65M Instruct
Lite · QuantFactory
Params65M
Context2K
Q4_K_M0.0 GB
GGUF
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing