Watch this video on YouTube

This is a continuation of my work to create a way to interact with Android when it is being displayed on a large scale using a projector.

The setup I’m using consists of a Kinect hooked up to a Windows PC running Simple Kinect Touch. This software processes the input from the Kinect and sends TUIO commands to a Galaxy Nexus running TuioForAndroid. These events get injected into the OS as touch events allowing control over any application. The projector is connected to the Galaxy Nexus with a MHL adapter.

In order to give TuioForAndroid system access I had to download the AOSP source tree and compile a rom for my Galaxy Nexus. TuioForAndroid must be signed with the System key so that it can get a system pid to inject the touch events into the OS.