GGUF models by RKNNAI

55 GGUF models quantized by RKNNAI on Hugging Face. Sizes run from 270M to 27B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
FU
Functiongemma 270m It
Functiongemma · RKNNAI
Params270M
Context32K
Smallest0.0 GB
Tool use
LF
LFM2.5 1.2B Instruct
Lfm · RKNNAI
Params1.2B
Context125K
Smallest0.0 GB
ReasoningTool use
QW
Qwen2.5 VL 3B Instruct
Qwen · RKNNAI
Params3B
Context125K
Smallest0.0 GB
Vision
MI
MiniCPM5 1B
MiniCPM · RKNNAI
Params1B
Context128K
Smallest0.0 GB
ReasoningTool use
QW
Qwen3.5 4B
Qwen · RKNNAI
Params4B
Context256K
Smallest0.0 GB
ReasoningTool useVision
QW
Qwen3 0.6B
Qwen · RKNNAI
Params600M
Context40K
Smallest0.0 GB
ReasoningTool use
LL
Meta Llama 3 8B Instruct
Llama · RKNNAI
Params8B
Context8K
Smallest0.0 GB
GGUF
FU
RK182X ASR Fun ASR Nano 2512
Fun · RKNNAI
Params600M
Context40K
Smallest0.0 GB
ReasoningTool use
QW
Qwen2.5 0.5B Instruct
Qwen · RKNNAI
Params500M
Context32K
Smallest0.0 GB
Tool use
OC
RK182X OCR HunyuanOCR 1.5
Ocr · RKNNAI
Params—
Context32K
Smallest0.0 GB
Vision
IN
InternVL3 2B
Internvl · RKNNAI
Params2B
Context32K
Smallest0.0 GB
Vision
MI
MinerU2.5 Pro 2604 1.2B
Mineru · RKNNAI
Params1.2B
Context8K
Smallest0.0 GB
Vision
LF
LFM2.5 2.6B
Lfm · RKNNAI
Params2.6B
Context128K
Smallest0.0 GB
ReasoningTool use
HU
Hunyuan MT 7B
Hunyuan · RKNNAI
Params7B
Context32K
Smallest0.0 GB
GGUF
TA
UI TARS 2B SFT
Tars · RKNNAI
Params2B
Context32K
Smallest0.0 GB
Vision
SM
SmolVLM 500M Instruct
Smolvlm · RKNNAI
Params500M
Context8K
Smallest0.0 GB
Vision
SM
SmolVLM2 500M Video Instruct
Smolvlm · RKNNAI
Params500M
Context8K
Smallest0.0 GB
Vision
LF
RK182X VLM LFM2.5 VL 3B
Lfm · RKNNAI
Params3B
Context32K
Smallest0.0 GB
ReasoningTool useVision
PA
PaddleOCR VL
Paddleocr · RKNNAI
Params—
Context128K
Smallest0.0 GB
Vision
LF
RK182X VLM LFM2.5 VL 1.6B
Lfm · RKNNAI
Params1.6B
Context125K
Smallest0.0 GB
Tool useVision
QW
Qwen3.5 9B
Qwen · RKNNAI
Params9B
Context256K
Smallest0.0 GB
ReasoningTool use
DE
Janus Pro 1B
DeepSeek · RKNNAI
Params1B
Context16K
Smallest0.0 GB
Vision
QW
Qwen3.8 27B
Qwen · RKNNAI
Params27B
Context256K
Smallest0.0 GB
ReasoningTool use
LO
RK182X VLM LocateAnything 3B
Locateanything · RKNNAI
Params3B
Context32K
Smallest0.0 GB
Tool useVision
QW
Qwen3.5 9B
Qwen · RKNNAI
Params9B
Context256K
Smallest0.0 GB
ReasoningTool useVision

Keep browsing