GGUF models by jkim96

65 GGUF models quantized by jkim96 on Hugging Face. Sizes run from 596M to 122B parameters. The longest trained context is 384K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
granite 4.1 8b DASHQ Q2
Granite · jkim96
Params8.79B
Context128K
Smallest2.8 GB
Tool use
QW
Qwen3.5 122B A10B DASHQ Q2
Qwen · jkim96
Params122B
Context256K
Smallest35.9 GB
GGUF
QW
Qwen2.5 VL 3B Instruct DASHQ Q2
Qwen · jkim96
Params3.09B
Context125K
Smallest0.9 GB
Vision
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · jkim96
Params8.03B
Context128K
Smallest2.5 GB
Tool use
GR
granite 4.1 30b DASHQ Q2
Granite · jkim96
Params28.9B
Context128K
Smallest8.0 GB
Tool use

Keep browsing