The December 2022 issue of IEEE Spectrum is here!

Close bar

Car Camera Network Could Produce Virtual Maps of Pedestrians

The ability to track the same people between different camera views could aid real-time traffic maps

2 min read
Car Camera Network Could Produce Virtual Maps of Pedestrians
Image: Swiss Federal Institute of Technology

A growing fleet of smart cars may add their street camera views to those of the surveillance camera networks already covering many major cities. That could open the door for a new technology that enables different video cameras to “talk” with one another and track the same individual person across many different camera views—possibly giving rise to Google Earth style maps that can display pedestrian and vehicle traffic.

The technology is based on a computer algorithm that can compare different camera views of the same person and learn to recognize the same individuals across many camera views by focusing on body color, texture and movement. Researchers envision a large-scale version of the system tracking pedestrian traffic on a virtual map—perhaps displayed on a car’s GPS screen—or enabling police to easily track fleeing suspects across multiple surveillance camera views.

Our idea is to enable the dynamic visualization of the realistic situation of humans walking on the road and sidewalks, so eventually people can see the animated version of the real-time dynamics of city streets on a platform like Google Earth,” said Jenq-Neng Hwang, a professor of electrical engineering at the University of Washington, in a news release.

Hwang’s team of researchers tested the algorithm with cameras placed on moving cars. They trained individual cameras learn to work together in pairs by training them on a certain set of test footage. Such testing led to the new work, which was presented at the Intelligent Transportation Systems Conference sponsored by IEEE and held in Qingdao, China.

But the technology does not have to work with only car-mounted cameras. The team has experimented with using their algorithm on cameras carried by flying drones. There is also no reason such an algorithm couldn’t eventually extend to existing surveillance camera systems in big cities such as New York City and London.

The algorithm could also aid law enforcement in tracking individuals across multiple surveillance cameras scattered across a city. Such capability could have come in handy for U.S. detectives hunting the Boston Marathon bombing suspects last year.

Hwang even describes how the algorithm could allow retail stores to track individual customers walking around and deduce their shopping preferences—perhaps enabling stores to quickly send a coupon for certain items to the shopper’s smartphone.

The number of cameras usable by the algorithm will likely only grow in the near future as flying drones fill the skies, car-mounted cameras continue to proliferate, and a growing number of pedestrians may walk around with smartphones in hand or smart glasses on their faces.

A technology that enables cameras to more easily track individual people could easily raise new privacy concerns. Hwang acknowledged such concerns in a University of Washington video, but emphasized the benefits for public safety. Just how individual communities choose to weigh that tradeoff in deploying such technnology remains to be seen. 

The Conversation (0)

Why Functional Programming Should Be the Future of Software Development

It’s hard to learn, but your code will produce fewer nasty surprises

11 min read
A plate of spaghetti made from code
Shira Inbar

You’d expectthe longest and most costly phase in the lifecycle of a software product to be the initial development of the system, when all those great features are first imagined and then created. In fact, the hardest part comes later, during the maintenance phase. That’s when programmers pay the price for the shortcuts they took during development.

So why did they take shortcuts? Maybe they didn’t realize that they were cutting any corners. Only when their code was deployed and exercised by a lot of users did its hidden flaws come to light. And maybe the developers were rushed. Time-to-market pressures would almost guarantee that their software will contain more bugs than it would otherwise.

Keep Reading ↓Show less