Lite GGUF models
92 GGUF models in the Lite family, quantized by 39 uploaders. Sizes run from 64M to 22.2B parameters. The longest trained context is 256K tokens.
LI
T Lite Instruct 0.1
Lite · BoloniniD
Params8.03B
Context8K
Smallest8.5 GB
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
T Lite It 1.0
Lite · evilfreelancer
Params7.61B
Context32K
Smallest3.0 GB
LI
o1 tlite unstable
Lite · Egor-3926
Params7.61B
Context32K
Smallest15.2 GB
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest5.7 GB
LI
T Lite It 1.0
Lite · kri1200
Params7.61B
Context32K
Smallest6.3 GB
LI
0x lite Q4 K M
Lite · ozone-research
Params14.8B
Context32K
Q4_K_M9.0 GB
LI
0x lite Q3 K S
Lite · ozone-research
Params14.8B
Context32K
Smallest6.7 GB
LI
T lite 0.1 Q4 K M
Lite · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Smallest5.7 GB
LI
0x lite Q4 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LI
2x lite Q2 K
Lite · ozone-research
Params14.8B
Context32K
Smallest5.8 GB
LI
T Lite It 1.0
Lite · MaliceTurtle
Params7.61B
Context32K
Smallest8.1 GB
LI
T lite 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
LI
T Lite Instruct 0.1
Lite · kurays
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
T Lite Instruct 0.1
Lite · elvispresniy
Params8.03B
Context8K
Smallest3.7 GB
LI
0x lite
Lite · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
LI
T Lite It 1.0
Lite · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
LI
0x lite Q5 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
LI
T Lite It 1.0
Lite · MilyaShams
Params7.61B
Context32K
Q4_K_M4.7 GB
LI
T Lite Instruct 0.1
Lite · ssl75
Params8.03B
Context8K
Smallest8.5 GB
LI
t lite 1.0
Lite · ichrnkv
Params7.61B
Context32K
Smallest4.7 GB
LI
T Lite It 1.0
Lite · vzotov
Params7.61B
Context32K
Smallest5.4 GB
LI
2x lite Q2 K
Lite · waltervix
Params14.8B
Context32K
Smallest5.8 GB
LI
Lite Oute 1 300M Instruct
Lite · moaaz2055
Params300M
Context4K
Smallest0.2 GB
LI
t lite Q4 K M
Lite · IDWLN
Params7.61B
Context32K
Q4_K_M4.7 GB
LI
t lite Q5 K M
Lite · IDWLN
Params7.61B
Context32K
Smallest5.4 GB
LI
t lite Q8 0
Lite · IDWLN
Params7.61B
Context32K
Smallest8.1 GB