Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · byteshape
Params23.6B
Context384K
Smallest6.9 GB
QW
Qwen 3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
OR
Ornith 1.5 35B A3B uncensored GGUF 8bit
Ornith · junafinity
Params35.5B
Context256K
Smallest37.8 GB
WI
Wicked Stuff 26B A4B v2.0 Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
RO
RoboInter VLM
Robointer · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8 Distilled 2B NPU2
Qwen · Atomic-Germ
Params1.88B
Context256K
Smallest2.0 GB
JA
JackOD 9B Coder
Jackod · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
PH
PhysX Omni
Physx · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
GE
Gemma 3 12b
Gemma · lmstudio-community
Params11.8B
Context128K
Smallest6.9 GB
ON
OneJev1.5 4B
Onejev · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
AG
Agents A1
Agents · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
Gemma 3 4b It
Gemma · Aldaris
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 31B It Uncensored Heretic NVFP4
Gemma · llmfan46
Params30.7B
Context256K
Smallest18.0 GB
GE
Gemma 4 E4B It GMCE
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · UserSuxx
Params389M
Context256K
Q4_K_M0.2 GB
GE
gemma 4 E4B it UD japanese imatrix
Gemma · dahara1
Params7.5B
Context128K
Q4_K_M5.0 GB
SE
Serenity 27B
Serenity · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
JP
jpt 4b
Jpt · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
AF
AfriqueQwen3.5 9B 50Langs
Afriqueqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 4 Queen 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
IN
InternVL3_5 4B
Internvl · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
GE
Gemma 4 12B It QAT SOMPOA Heresy
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
Mistral Small 4 119B 2603 NVFP4
Mistral · FedericoFB
Params119B
Context1024K
Smallest70.0 GB
QW
Qwen2.5 VL 3B Instruct Unredacted MAX
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
RY
RynnBrain CoP 8B
Rynnbrain · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5-4B
Qwen · Heppygaga
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 27B Full Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B xVITA zhTW
Gemma · xCloudinfo
Params30.7B
Context256K
Q4_K_M18.7 GB