Lite GGUF models

92 GGUF models in the Lite family, quantized by 39 uploaders. Sizes run from 64M to 22.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LI
T Lite Instruct 0.1
Lite · BoloniniD
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
T Lite It 1.0
Lite · evilfreelancer
Params7.61B
Context32K
Smallest3.0 GB
Reasoning
LI
o1 tlite unstable
Lite · Egor-3926
Params7.61B
Context32K
Smallest15.2 GB
Reasoning
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest5.7 GB
GGUF
LI
T Lite It 1.0
Lite · kri1200
Params7.61B
Context32K
Smallest6.3 GB
GGUF
LI
0x lite Q4 K M
Lite · ozone-research
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LI
0x lite Q3 K S
Lite · ozone-research
Params14.8B
Context32K
Smallest6.7 GB
Tool use
LI
T lite 0.1 Q4 K M
Lite · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
T Lite Instruct 0.1
Lite · Alex01837178373
Params8.03B
Context8K
Smallest5.7 GB
GGUF
LI
0x lite Q4 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
Tool use
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LI
2x lite Q2 K
Lite · ozone-research
Params14.8B
Context32K
Smallest5.8 GB
Tool use
LI
T Lite It 1.0
Lite · MaliceTurtle
Params7.61B
Context32K
Smallest8.1 GB
GGUF
LI
T lite 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
LI
T Lite Instruct 0.1
Lite · kurays
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
T Lite Instruct 0.1
Lite · elvispresniy
Params8.03B
Context8K
Smallest3.7 GB
GGUF
LI
0x lite
Lite · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Tool use
LI
T Lite It 1.0
Lite · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
GGUF
LI
0x lite Q5 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
Tool use
LI
T Lite It 1.0
Lite · MilyaShams
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
LI
T Lite Instruct 0.1
Lite · ssl75
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LI
t lite 1.0
Lite · ichrnkv
Params7.61B
Context32K
Smallest4.7 GB
GGUF
LI
T Lite It 1.0
Lite · vzotov
Params7.61B
Context32K
Smallest5.4 GB
GGUF
LI
2x lite Q2 K
Lite · waltervix
Params14.8B
Context32K
Smallest5.8 GB
Tool use
LI
Lite Oute 1 300M Instruct
Lite · moaaz2055
Params300M
Context4K
Smallest0.2 GB
Tool use
LI
t lite Q4 K M
Lite · IDWLN
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
LI
t lite Q5 K M
Lite · IDWLN
Params7.61B
Context32K
Smallest5.4 GB
GGUF
LI
t lite Q8 0
Lite · IDWLN
Params7.61B
Context32K
Smallest8.1 GB
GGUF

Keep browsing