GGUF models by hellork

39 GGUF models quantized by hellork on Hugging Face. Sizes run from 1.71B to 11.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
Indian law chat minor project IQ4 XS
Indian · hellork
Params6.74B
Context4K
Smallest3.6 GB
GGUF
IN
Internlm2 Chat 7b Sft
InternLM · hellork
Params7.74B
Context32K
Smallest4.5 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · hellork
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · hellork
Params7.74B
Context32K
Smallest4.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · hellork
Params2.61B
Context8K
Smallest1.6 GB
GGUF
GL
Chatglm3 6b 128k
GLM · hellork
Params6.24B
Context128K
Smallest3.6 GB
GGUF
GE
RYS Gemma 2 2b It
Gemma · hellork
Params3.63B
Context8K
Q4_K_M2.3 GB
GGUF
QW
CodeQwen1.5 7B Chat
Qwen · hellork
Params7.25B
Context64K
Smallest4.2 GB
GGUF
HU
HuatuoGPT O1 7B
Huatuogpt · hellork
Params7.62B
Context32K
Smallest3.1 GB
ReasoningTool use

Keep browsing