In the case of ATHLETE, using Leap Motion was an easy decision. Designed to be part of a lunar / martian exploration system and now slated for a potential asteroid mission, the massive 12-foot tall robot has half a dozen limbs each with six degrees of freedom, which lend themselves naturally to gesture-based controls. The crew had already built a hangar along with a series of trusses and pulleys to position ATHLETE on an asteroid test bed in order to simulate low gravity. They then mapped the physical space onto Unity-based software, which was configured for use with a variety of controllers, including the Leap.

We had a chance to try out the software ourselves, but without a robot connected at the other end. This editor hovered a hand over the sensor cautiously, and sure enough, the simulation responded like a giant claw. With a hand balled up in a fist and just one finger extended, we watched as the bot lifted a single limb as well. We were surprised by how responsive it was, though it might not be as precise as we would like in our incredibly brief demo. Of course, you can't tilt it too much and the legs can't bend backwards, but that's because the rover isn't supposed to do that either. It was a little unnerving, thinking that this flailing of fingers could translate to the movement of a robot in space.

The whole thing could easily be seen as a gimmick, but NASA doesn't think it is. "When we take ATHLETE to an asteroid, we have to make it fly," said Norris. "We need to move it as if it were zero gravity... the demos we've seen are actually quite amazing. We can see this enormous rover lazily falling and bouncing off things, as if it were a cloud."

Luo continued, saying that this is just a small subset of what JPL is trying to do. From NASA's first ever Xbox Live game, Mars Rover Landing, to its use of consumer-grade hardware, it's clear the agency wants to get everyday citizens excited about space travel again. With gaming-inspired projects like this one, that goal certainly seems within reach. To get a glimpse of the software in action with zSpace and Leap Motion sensors, have a look at the NASA-provided video above. For the GDC panel, check out the audience-captured clip below. If you have any additional questions or comments, feel free to contact Luo and Norris via Twitter; their handles are @victorocks and @jeffreynorris respectively.