GGUF models by SC117
34 GGUF models quantized by SC117 on Hugging Face. Sizes run from 447M to 177B parameters. The longest trained context is 1024K tokens.
QW
Qwen AgentWorld 35B A3B
Qwen · SC117
Params447M
Context256K
Smallest14.3 GB
AG
Agents A1
Agents · SC117
Params35.5B
Context256K
Smallest14.3 GB
NE
Nex N2 Mini
Nex · SC117
Params34.7B
Context256K
Smallest16.5 GB
HU
Huihui Nex N2 Mini Abliterated
Huihui · SC117
Params34.7B
Context256K
Smallest16.5 GB