Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 VL 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Qwen3.6 35B A3B Uncensored HauhauCS MTP
Qwen · morikomorizz
Params447M
Context256K
Smallest15.9 GB
OR
Ornith 1.5 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Huihui gemma 4 E4B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params7.46B
Context128K
Smallest0.2 GB
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · huihui-ai
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Qwen3.5 4B Uncensored LocalAI
Qwen · weareapexcreators
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · noctrex
Params30.5B
Context256K
Q4_K_M18.6 GB
XY
XYZ Aquila Mini
Xyz · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
AR
BAAI AREX 2
Arex · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · logic65
Params26.9B
Context256K
Q4_K_M17.4 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
OR
Ornith-1.5-122B
Ornith · AtomicChat
Params125B
Context256K
Smallest35.0 GB
MI
MiniCPM V 4_6
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5-0.8B
Qwen · weareapexcreators
Params773M
Context256K
Q4_K_M0.5 GB
QW
Qwen2 VL 2B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
LI
Ling 3.0 Flash VL
Ling · bartowski
Params124B
Context128K
Q4_K_M78.7 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated IQ3 S
Qwen · slider-meister-pub
Params177B
Context256K
Smallest83.7 GB
QW
Qwen3 VL 8B Instruct Abliterated v2
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled v2
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
JE
JEV 27B VL
Jev · Atlas3D
Params27B
Context256K
Q4_K_M16.5 GB
ST
StartLux-Decision-v1.1-4B-Instant
Startlux · startlux-models
Params4.2B
Context256K
Q4_K_M2.7 GB
ST
StartLux-Decision-v1.1-27B-Instant
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B-DFlash2
Qwen · perplexity-ai
Params27.3B
Context256K
Q4_K_M1.1 GB
FL
vllm-d3-flash
Flash · ggml-org
Params8.95B
Context256K
Q4_K_M6.6 GB
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
LF
LFM2 VL 1.6B
Lfm · LiquidAI
Params1.17B
Context125K
Smallest0.7 GB
PA
PaddleOCR VL 1.5
Paddleocr · PaddlePaddle
Params467M
Context128K
Smallest0.9 GB