GGUF models by RKNNAI
55 GGUF models quantized by RKNNAI on Hugging Face. Sizes run from 270M to 27B parameters. The longest trained context is 256K tokens.
FU
Functiongemma 270m It
Functiongemma · RKNNAI
Params270M
Context32K
Smallest0.0 GB
LF
LFM2.5 1.2B Instruct
Lfm · RKNNAI
Params1.2B
Context125K
Smallest0.0 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · RKNNAI
Params3B
Context125K
Smallest0.0 GB
MI
MiniCPM5 1B
MiniCPM · RKNNAI
Params1B
Context128K
Smallest0.0 GB
QW
Qwen3.5 4B
Qwen · RKNNAI
Params4B
Context256K
Smallest0.0 GB
QW
Qwen3 0.6B
Qwen · RKNNAI
Params600M
Context40K
Smallest0.0 GB
LL
Meta Llama 3 8B Instruct
Llama · RKNNAI
Params8B
Context8K
Smallest0.0 GB
FU
RK182X ASR Fun ASR Nano 2512
Fun · RKNNAI
Params600M
Context40K
Smallest0.0 GB
QW
Qwen2.5 0.5B Instruct
Qwen · RKNNAI
Params500M
Context32K
Smallest0.0 GB
OC
RK182X OCR HunyuanOCR 1.5
Ocr · RKNNAI
Params—
Context32K
Smallest0.0 GB
IN
InternVL3 2B
Internvl · RKNNAI
Params2B
Context32K
Smallest0.0 GB
MI
MinerU2.5 Pro 2604 1.2B
Mineru · RKNNAI
Params1.2B
Context8K
Smallest0.0 GB
LF
LFM2.5 2.6B
Lfm · RKNNAI
Params2.6B
Context128K
Smallest0.0 GB
HU
Hunyuan MT 7B
Hunyuan · RKNNAI
Params7B
Context32K
Smallest0.0 GB
TA
UI TARS 2B SFT
Tars · RKNNAI
Params2B
Context32K
Smallest0.0 GB
SM
SmolVLM 500M Instruct
Smolvlm · RKNNAI
Params500M
Context8K
Smallest0.0 GB
SM
SmolVLM2 500M Video Instruct
Smolvlm · RKNNAI
Params500M
Context8K
Smallest0.0 GB
LF
RK182X VLM LFM2.5 VL 3B
Lfm · RKNNAI
Params3B
Context32K
Smallest0.0 GB
PA
PaddleOCR VL
Paddleocr · RKNNAI
Params—
Context128K
Smallest0.0 GB
LF
RK182X VLM LFM2.5 VL 1.6B
Lfm · RKNNAI
Params1.6B
Context125K
Smallest0.0 GB
QW
Qwen3.5 9B
Qwen · RKNNAI
Params9B
Context256K
Smallest0.0 GB
DE
Janus Pro 1B
DeepSeek · RKNNAI
Params1B
Context16K
Smallest0.0 GB
QW
Qwen3.8 27B
Qwen · RKNNAI
Params27B
Context256K
Smallest0.0 GB
LO
RK182X VLM LocateAnything 3B
Locateanything · RKNNAI
Params3B
Context32K
Smallest0.0 GB
QW
Qwen3.5 9B
Qwen · RKNNAI
Params9B
Context256K
Smallest0.0 GB