Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · maerong3
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
QW
Qwen3 VL 8B Heretic Stable
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
HO
Holo4 35B A3B
Holo · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
SA
Sabi Noema
Sabi · owao
Params27B
Context256K
Q4_K_M16.5 GB
RE
Blackfrost-AI/RED-SNOW-5.3-FLASH-BF16
Red · freakyskittle
Params321B
Context1024K
Q4_K_M181.5 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes Final NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.1 GB
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.6 35B Uncensored HauhauCS 1M
Qwen · satgeze
Params447M
Context1024K
Q4_K_M21.7 GB
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
ST
StartLux Decision 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MA
UI Mate 9B
Mate · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
ST
Step-5-Preview-BF16
Step · L-Alchemyst
Params601B
Context1024K
Smallest248.8 GB
FA
Fara1.5 9B
Fara · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Qwen3.8-27B-Uncensored-Aggressive
Qwen · 0xKitkat
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Gliese Qwen3.5 9B Abliterated Caption
Qwen · prithivMLmods
Params8.95B
Context256K
Smallest9.5 GB
MI
MiniCPM V 4.7 1B heretic
MiniCPM · saidutta69
Params1.01B
Context256K
Q4_K_M0.7 GB
QW
Qwen3 VL 30B A3B Instruct
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.6 35B A3B 2Bit GSQ hybrid
Qwen · chtisgit
Params34.7B
Context256K
Smallest12.2 GB
GE
Gemma 4 E2B it Artemis
Gemma · turintech
Params4.63B
Context128K
Smallest0.1 GB
NE
Huihui NeoHorse 1 4B Abliterated MTP
Neohorse · huihui-ai
Params4.33B
Context256K
Smallest2.3 GB
QW
Qwen3.6 VL REAP 26B A3B
Qwen · keithnull
Params26.6B
Context256K
Q4_K_M16.3 GB
GE
gemma 4 31B it
Gemma · AtomicChat
Params30.7B
Context256K
Q4_K_M18.7 GB
OR
Ornith 1.5 35B A3B
Ornith · SC117
Params447M
Context256K
Smallest14.4 GB
QW
Qwen3.5 122B A10B Uncensored Heretic
Qwen · llmfan46
Params125B
Context256K
Q4_K_M85.3 GB
QW
JoyFox-Qwen3.6-35B-A3B-RP-Aggressive
Qwen · joyfox
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3Vl 8b Thinking
Qwen · Qwen
Params8.19B
Context256K
Q4_K_M5.0 GB
MU
music flamingo
Music · henry1477
Params7.6B
Context32K
Smallest3.0 GB
GE
gemma 4 31B it scotoma 2
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB