GGUF models by hellork
39 GGUF models quantized by hellork on Hugging Face. Sizes run from 1.71B to 11.7B parameters. The longest trained context is 1024K tokens.
IN
Indian law chat minor project IQ4 XS
Indian · hellork
Params6.74B
Context4K
Smallest3.6 GB
IN
Internlm2 Chat 7b Sft
InternLM · hellork
Params7.74B
Context32K
Smallest4.5 GB
IN
Internlm2_5 7b Chat
InternLM · hellork
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2_5 7b Chat
InternLM · hellork
Params7.74B
Context32K
Smallest4.5 GB
GE
Gemma 2 2b It
Gemma · hellork
Params2.61B
Context8K
Smallest1.6 GB
GL
Chatglm3 6b 128k
GLM · hellork
Params6.24B
Context128K
Smallest3.6 GB
GE
RYS Gemma 2 2b It
Gemma · hellork
Params3.63B
Context8K
Q4_K_M2.3 GB
QW
CodeQwen1.5 7B Chat
Qwen · hellork
Params7.25B
Context64K
Smallest4.2 GB
HU
HuatuoGPT O1 7B
Huatuogpt · hellork
Params7.62B
Context32K
Smallest3.1 GB