leapMouse.tox - Leap Motion for Simulating Touch Screen

A Leap Motion (or Kinect etc) can act as a virtual mouse + click on a TouchDesigner panel.

This file lets you orient a Leap Motion (or anything that tracks finger/hand XYZ) in any position and rotation near a flat screen, calibrate to the screen so that across the screen is U=0 to 1, and then use your finger to move a cursor and simulate a tap on a screen (U, V and select).

When you start it up, use your real mouse/trackpad to click Press to Calibrate. Press the Start Calibration parameter. It will then display a grid and ask you to put your finger at the center of the screen, and then click the mouse anywhere on the screen. etc. etc.

Once you are familiar with its operation, you can then copy the leapMouse component into your application and use it to operate a full-screen TouchDesigner panel. Look at the leapMouse component’s custom parameters where you can set it up and start the calibration.

To make it work with other devices like Kinect, replace the Leap Motion CHOP and select the appropriate channels with the Select CHOP.

Internally this sends a Panel.interactMouse() message to the panel.

But it could also be retrofitted with nVoid’s full-screen mouse-simulator: viewtopic.php?f=22&t=9929
LeapMouse088.648.toe (46.7 KB)

2 Likes