jking22 - 2018-06-22

Does anyone know how to throw mouse click events in Codesys Runtime code?
e.g.
resp = SomeLib.MouseClick(300,200);

Basically the general thought would be...
1. Codesys Controller with Video Out.
2. Video to USB Capture Device...
* https://www.amazon.com/AV-io-HD-video-c ... 00ZH7HRKW/
* This one is plug and play and act's like a web-cam.
* It's really easy to write code to create an application to display the video stream and Mouse events.

  1. Sikuli
    * http://www.sikuli.org/
    * GUI Unit testing framework that uses image recognition for object detection...
  2. Write some Codesys Code receive click events (RS232, Sockets etc) or change screen commands from sikuli or applications.. process click events and return current visu information.

If you could integrate this together, you could create a pretty powerful VISU Testing framework...
e.g. something like... (Just pseudocode for sikuli or test framework)
changeScreen('Main_Visu')
assert.exists('ChangeScreen.jpg')
framework.click('ChangeScreen.jpg')
sleep_ms(2000)
Assert(current_Visu = 'NextString')

Thoughts? Anyone doing anything similar.