Using a mobile robot equipped with a laser-range sensor, an RGB depth camera and a 4K panoramic image camera, the team can virtually reproduce the interiors of buildings in what it calls "Building-scale VR". The mobile robot also scans individual physical objects by moving around them automatically. In the disaster simulations, both the building and objects can be manipulated, giving the VR headset wearer the opportunity to safely experience potentially dangerous situations, which according to the researchers is just as, if not more, effective than real world training. Future work will include large-scale experiments with indoor 3D maps of more complicated buildings, such as libraries and museums.

UPDATE: This post has been edited to correctly attribute the work to Nagoya University, not Microsoft.