Can Drivers Assist Their Own Driver Assistance Systems?

Until cars can drive themselves they will have to learn how to consult with the human behind the wheel

2 min read
Can Drivers Assist Their Own Driver Assistance Systems?
As the subject drives a simulated car, researchers record his body language
Photo: University of California, Berkeley

Until cars can take over the driving entirely, we humans will just have to share the job with them, exploiting the strengths and masking the weaknesses peculiar to each side—carbon and silicon.

The biggest human weakness may well be our tendency to be lulled into complacency by robots that drive perfectly almost, but not quite all, of the time. One of the biggest machine weaknesses is in making certain judgment calls. (They’re not great at spotting potholes, for instance.)

Most researchers are so intent on getting driver-assistance systems to stand alone that they dismiss human behavior as mere noise in the system. But some boffins at Berkeley want to make full use of that behavior by telling the machines when to defer to the driver.

Call it driver assistance for driver assistance.

“It’s incredibly important to include the human, not just as something to consider as a disturbance,” says Katherine Driggs Campbell, who is leading the project. She is a doctoral candidate in electrical engineering, under the supervision of professor Ruzena Bajcsy.

The researchers use cameras to monitor posture, head, and eye movements. (A Microsoft Kinect determines posture by measuring the position of a person’s joints.) Those measurements are fed into a model that processes them so the automated systems can guess when people are losing their concentration. That’s when the robot stops deferring and starts intervening. 

“It’s sometimes hard to tell from body position whether the driver is using a phone or just holding it up,” Campbell says. “Now, in our most recent iteration, we can pull information from the phone as well, to see if you’re actually using it.”

Right now the system is trained on individual drivers. “We’ve worked on creating a more generalized model,” Campbell says, “but that would need at least a coarse breakdown into various types of drivers.”

“We shrink down the set of what people might do to the more likely things,” Campbell says. In a just-published account of their earlier work, the researchers looked only at driving events that unfolded within 1.2 seconds. Now they’re looking as far as 2 seconds ahead, which is actually rather a long time, given how fast a car can be sailing down the road.

Most of the experiments have been conducted on people operating automobile simulators, but the researchers are in the process of validating their results in real cars that drive on a special testbed. The cars and the funding come from Hyundai.

Plenty of difficulties remain, even the old familiar one of driver complacency. Often, Campbell says, “the driver either became more reliant on the controller or reacted in a negative way, getting slightly panicked.”

Maybe the next step is to get the car to help the human help the car—help the human.​

The Conversation (0)

Self-Driving Cars Work Better With Smart Roads

Intelligent infrastructure makes autonomous driving safer and less expensive

9 min read
A photograph shows a single car headed toward the viewer on the rightmost lane of a three-lane road that is bounded by grassy parkways, one side of which is planted with trees. In the foreground a black vertical pole is topped by a crossbeam bearing various instruments. 

This test unit, in a suburb of Shanghai, detects and tracks traffic merging from a side road onto a major road, using a camera, a lidar, a radar, a communication unit, and a computer.

Shaoshan Liu

Enormous efforts have been made in the past two decades to create a car that can use sensors and artificial intelligence to model its environment and plot a safe driving path. Yet even today the technology works well only in areas like campuses, which have limited roads to map and minimal traffic to master. It still can’t manage busy, unfamiliar, or unpredictable roads. For now, at least, there is only so much sensory power and intelligence that can go into a car.

To solve this problem, we must turn it around: We must put more of the smarts into the infrastructure—we must make the road smart.

Keep Reading ↓Show less