GGUF models by jkim96
65 GGUF models quantized by jkim96 on Hugging Face. Sizes run from 596M to 122B parameters. The longest trained context is 384K tokens.
GR
granite 4.1 8b DASHQ Q2
Granite · jkim96
Params8.79B
Context128K
Smallest2.8 GB
QW
Qwen3.5 122B A10B DASHQ Q2
Qwen · jkim96
Params122B
Context256K
Smallest35.9 GB
QW
Qwen2.5 VL 3B Instruct DASHQ Q2
Qwen · jkim96
Params3.09B
Context125K
Smallest0.9 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · jkim96
Params8.03B
Context128K
Smallest2.5 GB
GR
granite 4.1 30b DASHQ Q2
Granite · jkim96
Params28.9B
Context128K
Smallest8.0 GB