Ford recently announced that it is teaming up with Intel to create a user interface system in their vehicles that will recognize faces and gestures. The project, Mobile Interior Imaging or “Project Mobii,” is a joint research project that will use facial recognition software, interior cameras, and data analytics in order to facilitate a personalized interaction between the car and driver.

Although the project is still in its experimental phase, many experts are anticipating what this system could provide for the next generation of vehicles.

Driver Authentication

One use of facial recognition software in vehicles will be authentication of the driver. This could provide additional safety for the vehicle by ensuring only authorized drivers use the vehicle. When an unrecognized driver gets into the driver’s seat, the car could take a picture and send it to the owner’s cell phone.

The owner could then set permissions and restrictions, including adjusting the music volume, allowing phone access, and limiting the driving speed from anywhere. It also allows parents to put restrictions on young drivers to ensure their safety while driving.

In addition to this safety feature, the driver recognition software could make it easy for all personalized data, such as music, contacts, seat placement, mirrors, and more, to be adjusted to the preset preferences for that person right away, without touching a button. The camera could also be used to allow owners to look inside their car from anywhere.

Truly Hands Free

Facial recognition software could also make the cars of the future truly hands free. Although many cars now have voice recognition software for some components of the vehicle, such as phone and music, there are still some components that must be controlled by a button. The new program could allow for hand gestures and voice commands to control everything, including windows, sunroofs, climate control, and more. This could make driving safer, with fewer distractions for the driver.

It also recognizes who is making the gestures, which could enhance some current features of a car. For example, currently most navigation systems cannot be used while the car is in motion due to safety restrictions, even if the passenger is inputting the data. This new system could recognize when a passenger is inputting the data and remain active, while remaining off if the driver reaches for the controls.

An Idea was Born

Ford looks at this project as a natural progression from what they already do. This system builds off of Ford’s current interface system that already uses exterior vehicle cameras to alert drivers when they drift into other lanes or get too close to other cars or objects. Ford also already use integrated smart devices to connect the vehicle with the user outside of the car, helped pioneer OnStar, and have just announced the inclusion of SYNC 911 Assist on the latest Mustang model.

The project began when Don Butler, the executive director of connected vehicles and services, visited Intel, where he learned about current projects involving pattern recognition, image and gesture recognition. He felt that partnering with Intel could enhance the systems they already use to create the next best user interface system for vehicles. The project has anthropologists, ethnographers, and engineers working together to create the best and more personalized experience between car and driver.

Ford puts the customer first, and insists that the customer will own the data, although the company will also use the analysis to enhance customer experience. Although it will probably be years before this system, or a similar one, becomes available for users, it does show that facial recognition software in vehicles will soon be a reality.