The February 2023 issue of IEEE Spectrum is here!

Close bar

Teaching Cars To Feel Your Pain

Your car will one day read your face, the better to understand you—and humor you

1 min read
Teaching Cars To Feel Your Pain
Image: EPFL-LTS5/PSA

Now we drive our cars; in the future, they'll drive us. In between, though, the division of labor will get a little murky, and there could be an unfortunate failure to communicate. Our cars will just have to learn to read us better.

The car that can see a driver's emotional state written on his face could anticipate a bout of road rage and head it off. It could offer advice, or it could just humor the poor, carbon-based life-form. "Yes, that fellow in the red sports car really was rather thoughtless," the car might say, sympathetically. "They really shouldn't let people—I mean, people like himon the road, should they?"

The facial-recognition part of that scheme is under investigation at the Signals Processing Laboratory of the École Polytechique Fédéral, in Lausanne, Switzerland. Researchers trained the system on photos to identify anger or the closely related emotion disgust, then validated the system by testing it on videos, including many taken inside a moving car (provided by the French auto maker Peugeot Citroën, a collaborator in this research).

 

There are five other basic emotions that future face-reading systems may tackle. This online test lets you measure your own ability to read these emotions. 

The researchers say they still have problems coping with the diverse ways in which different people express an emotion. They propose to have the car engage in on-the-job learning: it would update its database again and again, based on the face of just one person—the driver.

Another problem is how to evaluate faces in real time. That job will require the development of faster algorithms for deconstructing the many combinations of muscular motions on the face. Biometricians recognize nearly 50 key motions of this sort, called "facial action units.

The Conversation (0)

Chinese Joint Venture Will Begin Mass-Producing an Autonomous Electric Car

With the Robo-01, Baidu and Chinese carmaker Geely aim for a fully self-driving car

4 min read
A black car sits against a white backdrop decorated with Chinese writing. The car’s doors are open, like a butterfly’s wings. Two charging stations are on the car’s left; two men stand on the right.

The Robo-01 autonomous electric car shows off its butterfly doors at a reveal to the media in Beijing, in June 2022.

Tingshu Wang/Reuters/Alamy
Purple

In October, a startup called Jidu Automotive, backed by Chinese AI giant Baidu and Chinese carmaker Geely, officially released an autonomous electric car, the Robo-01 Lunar Edition. In 2023, the car will go on sale.

At roughly US $55,000, the Robo-01 Lunar Edition is a limited edition, cobranded with China’s Lunar Exploration Project. It has two lidars, a 5-millimeter-wave radars, 12 ultrasonic sensors, and 12 high-definition cameras. It is the first vehicle to offer on-board, AI-assisted voice recognition, with voice response speeds within 700 milliseconds, thanks to the Qualcomm Snapdragon 8295 chip.

Keep Reading ↓Show less