The December 2022 issue of IEEE Spectrum is here!

Close bar

Simple Robots Perform Complex Tasks With Environmental Modifications

Robots learn to modify their environment to make the impossible possible

3 min read
Modular robot completing tasks by deploying and crossing bridges and ramps made of building blocks
Photo: University of Pennsylvania/ModLab

There’s an expectation in robotics that in order to be useful, robots have to be able to adapt to unstructured environments. Unstructured environments generally refer to places outside of a robotics lab or other controlled or semi-controlled situation, and could include anything from your living room to a tropical rainforest. An enormous amount of effort and creativity goes into designing robots that can reliably operate in places like these, with a focus on developing methods of sensing, locomotion, and manipulation that handle all kinds of different situations. It’s a very hard problem; even for humans, it’s hard, so we do a very human thing. We cheat.

Cheating, in this context, means instead of adapting to an environment, you instead adapt the environment itself, modifying it so you can complete different tasks. Humans do this all the time, by using stepping stools to reach high places, adding stairs and ramps to overcome obstacles, attaching handles to objects to make manipulation easier, and so on. A robot that could do similar sorts of things has the potential to be far more capable than a robot that is simply passively adaptable, and at the IEEE International Conference on Robotics and Automation last week, we saw some new research that’s making it happen.

SMORES-EP is a robot from the University of Pennsylvania’s ModLab. It’s made up of an arbitrary number of independent wheeled cubes that can attach to one another magnetically in multiple configurations to form a larger cooperative robot that’s more capable than any single module alone. While robots like these are generally comprised of identical modules, it’s not all that much of a stretch to consider ways in which it might be beneficial to incorporate other objects into the system that might be actively or passively useful. 

For example, modular robots can have trouble dealing with crossing gaps or climbing up stairs or ledges, because modular robots don’t scale well beyond a handful of individual modules. Rather than trying to find a way for the robot to handle obstacles like these, researchers from UPenn and Cornell decided to teach the robot to modify its environment by giving it access to blocks and ramps that it could (autonomously) use to make obstacles less obstacle-y.

This behavior is completely autonomous: The system is given a high-level task to accomplish, and the ramps and blocks are placed in the environment for it to use if it decides that they’d come in handy, but it doesn’t have explicit instructions about what to do every time. The video above shows some example tasks, but the system has no problem generalizing to other tasks in other environments that may require different environment augmentations.

Ramps and blocks are just two examples of objects that robots could use to augment their environment. It’s easy to imagine how a robotic system could carry augmentations with it (or the materials to construct them), or perhaps even scavenge materials locally, building things like ramps out of dirt or rocks. Heterogeneous teams of robots could include construction robots that modify obstacles so that scout robots can traverse them. And mobility is just one example of environmental augmentation: Perception is a challenge for robots, but what if you had a robot with lots of fancy sensors scout out an environment, and then place fiducials or RFID markers all over the place so that other robots with far cheaper sensors could easily navigate around and recognize objects? Of course, doing things like this may have an impact on any humans in the environment as well, which is something that the robots will likely have to consider. There’s a lot of potential here, and we’re excited to see what the researchers make of it.

“Perception-Informed Autonomous Environment Augmentation With Modular Robots,” by Tarik Tosun, Jonathan Daudelin, Gangyuan Jing, Hadas Kress-Gazit, Mark Campbell, and Mark Yim from the University of Pennsylvania and Cornell University, was presented at ICRA 2018 in Brisbane, Australia.

The Conversation (0)

The Bionic-Hand Arms Race

The prosthetics industry is too focused on high-tech limbs that are complicated, costly, and often impractical

12 min read
A photograph of a young woman with brown eyes and neck length hair dyed rose gold sits at a white table. In one hand she holds a carbon fiber robotic arm and hand. Her other arm ends near her elbow. Her short sleeve shirt has a pattern on it of illustrated hands.

The author, Britt Young, holding her Ottobock bebionic bionic arm.

Gabriela Hasbun. Makeup: Maria Nguyen for MAC cosmetics; Hair: Joan Laqui for Living Proof

In Jules Verne’s 1865 novel From the Earth to the Moon, members of the fictitious Baltimore Gun Club, all disabled Civil War veterans, restlessly search for a new enemy to conquer. They had spent the war innovating new, deadlier weaponry. By the war’s end, with “not quite one arm between four persons, and exactly two legs between six,” these self-taught amputee-weaponsmiths decide to repurpose their skills toward a new projectile: a rocket ship.

The story of the Baltimore Gun Club propelling themselves to the moon is about the extraordinary masculine power of the veteran, who doesn’t simply “overcome” his disability; he derives power and ambition from it. Their “crutches, wooden legs, artificial arms, steel hooks, caoutchouc [rubber] jaws, silver craniums [and] platinum noses” don’t play leading roles in their personalities—they are merely tools on their bodies. These piecemeal men are unlikely crusaders of invention with an even more unlikely mission. And yet who better to design the next great leap in technology than men remade by technology themselves?

Keep Reading ↓Show less