Helpingai GGUF models

79 GGUF models in the Helpingai family, quantized by 14 uploaders. Sizes run from 110M to 17.5B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
HelpingAI2.5 2B
Helpingai · HelpingAI
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
HE
HelpingAI 3
Helpingai · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
HE
OEvortex HelpingAI Lite 2x1B
Helpingai · tensorblock
Params1.86B
Context2K
Smallest0.7 GB
Coding
HE
HelpingAI unvelite
Helpingai · OEvortex
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
HE
HelpingAI-Lite-4x1b
Helpingai · RichardErkhov
Params3.38B
Context2K
Q4_K_M2.0 GB
GGUF
HE
HelpingAI2.5 2B
Helpingai · ysn-rfd
Params1.71B
Context8K
Smallest1.0 GB
GGUF
HE
HelpingAI2.5 5B
Helpingai · ysn-rfd
Params5.13B
Context128K
Smallest3.0 GB
Tool use
HE
HelpingAI-110M
Helpingai · RichardErkhov
Params110M
Context1K
Q4_K_M0.1 GB
GGUF
HE
HelpingAI-9B-200k
Helpingai · OEvortex
Params8.83B
Context195K
Q4_K_M5.3 GB
GGUF
HE
HelpingAI 9B 200k
Helpingai · QuantFactory
Params8.83B
Context195K
Q4_K_M5.3 GB
GGUF
HE
HelpingAI 3B chat
Helpingai · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HE
HelpingAI 3
Helpingai · tensorblock
Params10.3B
Context32K
Smallest3.9 GB
GGUF
HE
HelpingAI Lite
Helpingai · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
HE
HelpingAI2 4x6B
Helpingai · Abhaykoul
Params17.5B
Context8K
Q4_K_M10.6 GB
GGUF
HE
HelpingAI2.5 10B
Helpingai · cutycat2000x
Params10.2B
Context128K
Q4_K_M6.2 GB
Tool use
HE
HelpingAI 3B Reloaded
Helpingai · mattritchey
Params2.81B
Context128K
Q4_K_M1.8 GB
Tool use
HE
HelpingAI2.5 10B
Helpingai · VarunGuptaPy
Params10.2B
Context128K
Q4_K_M6.2 GB
Tool use
HE
HelpingAI 3 Q4 K M
Helpingai · VarunGuptaPy
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
HE
Helpingai3 Raw
Helpingai · VarunGuptaPy
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF

Keep browsing