With the help of machine learning to classify device types, this phone was able to accurately toggle the corresponding apps or charms by merely tapping on almost anywhere on a variety of connected devices: Phillips Hue LED bulb, fridge, TV, thermostat, router, smart door lock, projector and more. Even "dumb" devices such as a coffee machine can be recognized, it's just that the phone obviously wouldn't be able to control them, but one could implement other types of interaction (maybe launch a coffee capsule catalog upon tapping?).

In another set of demos, the team showed how the phone could show contextual charms upon tapping various connected devices. For instance, tapping a monitor would give you the option to send either files or pre-selected text from the phone to the PC (which sounds more straightforward than the NFC feature in Windows); whereas tapping a TV or a Chromecast Audio would give you the cast button.

While the prototype phone has a dongle sticking out from the bottom, Future Interfaces Group reckoned the commercialized version of this electromagnetic-sensing technology may be able to use the phone's existing antenna or metallic chassis to achieve the same goal. Another challenge is to improve noise rejection and also fine-tune this technique, so that devices of the same model can be distinguished from the minute differences in their electromagnetic signatures, which is something that Disney Research appeared to be confident in. As to when we may see this feature on future smartphones, group director Chris Harrison said it'll be at least a year before it gets commercialized -- much like the team's other recent project, Electrick.