Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DO
Dots3 Note Prev
Dots · bartowski
Params280B
Context512K
Q4_K_M171.1 GB
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
BL
Q3.5 BlueStar 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwopus3.6 35B A3B v1
Qwen · Jackrong
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 27B Heretic
Qwen · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GE
Gemma 3 12b It Heretic
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
MiMo-V2.6-Flash-MOPD
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params447M
Context256K
Smallest14.1 GB
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
MO
moondream2
Moondream · moondream
Params1.42B
Context2K
Smallest2.8 GB
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
QW
Qwen3 VL Embedding 8B
Qwen · VesNFF
Params7.6B
Context256K
Smallest6.2 GB
PA
PaddleOCR VL manga
Paddleocr · LunarOilRig
Params467M
Context128K
Q4_K_M0.3 GB
QW
Qwen3.5 9B Gemini 3.1 Pro Reasoning Distill
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.7 GB
ME
Medgemma-27B-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
KI
Kimi VL A3B Instruct
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
KA
KAT Coder V2.5 Dev 35B A3B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Kat · PhillyLabs
Params34.7B
Context256K
Q4_K_M21.2 GB
LI
LightOnOCR 3 1B
Lightonocr · prithivMLmods
Params596M
Context16K
Q4_K_M0.4 GB
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen2.5 Vl 7b Cam Motion
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Irwan LightOnOCR 3 0.8B Abliterated
Qwen · irwanworld
Params752M
Context256K
Smallest0.8 GB
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.6 27B Uncensored Heretic v2
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context125K
Q4_K_M19.9 GB