We turned my phone into a universal remote that uses augmented reality. We can track the location of objects and identify them in real time, so we can overlay an icon representing the object on the video shown on the touchscreen. Simply click on the object to interact with it. It’s all wireless, no base station required.

http://www.youtube.com/watch?v=svA_LgLgTUE

Actual video is 1080p, I recommend you view it full screen.

Presentation slides: without notes and with notes

Photos:



Our group did circuit and PCB design, we did the soldering, we designed the phone casing, we designed all the IR and RF protocols, we wrote our own firmware and Android app.

We have many visions on how to improve our system. We know how to improve our noise and interference immunity, plus increase the tracking speed performance. We have several ideas on how to make the phone-attached-circuit less bulky. We know how to use multiple emitters to estimate the object’s size and orientation.

We are trying to gauge interest in our project, to see whether or not to continue the project, and in which direction to take it in.

Abstract (exactly as we submitted it)

Augmented reality provides individuals with a virtually enhanced

method of viewing and interacting with the world around them. The

Augmented Reality Universal Controller and Identifier (ARUCI) is a

real-time system that integrates remote object control with augmented

reality to view and control various objects through an interactive

visual interface that can be installed on an android smartphone. The

ARUCI system incorporates both physical hardware, and a platform that

allows users to upload and configure control mechanisms for various

electronic objects such as lighting and appliances. By pointing ARUCI

in the direction of any compatible object, the user can identify

details about it. For configured electronic devices, ARUCI can also

control them remotely via an augmented reality overlay on the

smartphone. The goal of this system is to improve the way people view

and interact with all of the electronics around them.

Q & A (updated as people ask questions)