Helpingai GGUF models

79 GGUF models in the Helpingai family, quantized by 14 uploaders. Sizes run from 110M to 17.5B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
HE
HelpingAI 15B
Helpingai · QuantFactory
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
HE
HelpingAI2 9B
Helpingai · HelpingAI
Params8.9B
Context128K
Smallest6.2 GB
Tool use
HE
HelpingAI 3 i1
Helpingai · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
HE
HelpingAI2 6B
Helpingai · HelpingAI
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
HE
HelpingAI 3B chat i1
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HE
HelpingAI2 6B
Helpingai · mradermacher
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
HE
HelpingAI2.5 5B
Helpingai · mradermacher
Params5.13B
Context128K
Q4_K_M3.2 GB
Tool use
HE
HelpingAI 9B
Helpingai · nold
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
HE
HelpingAI-15B
Helpingai · HelpingAI
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
HE
HelpingAI Lite
Helpingai · mradermacher
Params3.38B
Context2K
Q4_K_M2.0 GB
Tool use
HE
HAI3 RAW
Helpingai · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
HE
Models HelpingAI Helpingai3 Raw
Helpingai · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
GGUF
HE
HelpingAI 3B chat
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HE
HelpingAI2 3B
Helpingai · mradermacher
Params2.81B
Context128K
Q4_K_M1.8 GB
Tool use
HE
HelpingAI Lite 1.5T
Helpingai · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
HE
HelpingAI-15B
Helpingai · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
HE
HelpingAI Lite 2x1B
Helpingai · mradermacher
Params1.86B
Context2K
Q4_K_M1.1 GB
Coding
HE
HelpingAI2 6B
Helpingai · mradermacher
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
HE
HelpingAI2.5 10B 1M
Helpingai · mradermacher
Params9.78B
Context1024K
Q4_K_M6.0 GB
GGUF
HE
HelpingAI2.5 10B 1M
Helpingai · mradermacher
Params9.78B
Context1024K
Q4_K_M6.0 GB
GGUF
HE
HelpingAI2.5 2B
Helpingai · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
HE
HelpingAI Lite 1.5T
Helpingai · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
HE
HelpingAI-9B
Helpingai · HelpingAI
Params8.83B
Context4K
Smallest5.0 GB
GGUF
HE
HelpingAI2 9B
Helpingai · mradermacher
Params8.9B
Context128K
Q4_K_M5.4 GB
Tool use
HE
HelpingAI flash
Helpingai · OEvortex
Params2.24B
Context4K
Q4_K_M1.4 GB
GGUF
HE
HelpingAI2 3B
Helpingai · mradermacher
Params2.81B
Context128K
Q4_K_M1.8 GB
Tool use
HE
HelpingAI-3B-chat
Helpingai · OEvortex
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HE
HELVETE
Helpingai · HelpingAI
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
HE
HelpingAI 3B hindi
Helpingai · OEvortex
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HE
OEvortex HelpingAI Lite
Helpingai · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF

Keep browsing