Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.8
Qwen · cHunter789
Params27B
Context256K
Smallest14.8 GB
MI
Mistral Small 4 119B 2603
Mistral · bartowski
Params119B
Context1024K
Q4_K_M72.6 GB
QW
Qwen3.5-2B
Qwen · weareapexcreators
Params1.94B
Context256K
Q4_K_M1.3 GB
ST
StartLux-Decision-v1.1-9B-AutoThink
Startlux · startlux-models
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 2B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3 ASR 0.6B
Qwen · ggml-org
Params752M
Context64K
Smallest0.8 GB
GL
GLM 4.6V Flash
GLM · ggml-org
Params9.4B
Context128K
Q4_K_M6.2 GB
QW
Qwen3.5-4B
Qwen · weareapexcreators
Params4.33B
Context256K
Q4_K_M2.8 GB
GE
Gemma 4 E2B it LocalAI
Gemma · weareapexcreators
Params7.5B
Context128K
Q4_K_M5.0 GB
GE
Gemma4 12B Uncensored LocalAI
Gemma · weareapexcreators
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 3.6 27B blend
Qwen · JetBrains
Params27.3B
Context256K
Q4_K_M1.1 GB
GL
GLM 4.6V
GLM · ggml-org
Params107B
Context128K
Q4_K_M70.4 GB
BO
Bonsai-27B
Bonsai · weareapexcreators
Params27B
Context256K
Smallest3.8 GB
CH
Chandra Ocr 2
Chandra · prithivMLmods
Params4.84B
Context256K
Q4_K_M3.1 GB
MI
MiniCPM OCR 1.0
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.6 35B A3B Uncensored LocalAI
Qwen · weareapexcreators
Params34.7B
Context256K
Smallest11.7 GB
FL
flux 3 image klein pup
Flux · unsloth
Params8.95B
Context256K
Q4_K_M5.6 GB
MU
Muse-Glimmer-30B
Muse · AtomicChat
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
DeepSeek V4 Pro Qwen3.5 9B MTP Public 20260801 HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8-27B
Qwen · weareapexcreators
Params27.3B
Context256K
Smallest10.7 GB
IN
Index Translate 35B A3B preview
Index · IndexTeam
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8 27B Uncensored FIT
Qwen · SC117
Params27B
Context256K
Smallest7.5 GB
QW
Qwen3.5-9B
Qwen · weareapexcreators
Params9.2B
Context256K
Q4_K_M5.9 GB
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MinerU2.5 Pro 2605 1.2B
Mineru · jinzhenj
Params494M
Context8K
Smallest0.5 GB
TR
Translategemma 12b It
Translategemma · bullerwins
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen2.5-Omni-7B
Qwen · unsloth
Params7.62B
Context32K
Q4_K_M4.7 GB