The December 2022 issue of IEEE Spectrum is here!

Close bar

Aussies Win Amazon Robotics Challenge

How a team of Australian engineers and their robot, named Cartman, won the Amazon Robotics Challenge

4 min read
Peter Corke, director of the Australian Centre for Robotic Vision at Queensland University of Technology, and other members of Team ACRV work on their robot, named Cartman, which won the 2017 Amazon Robotics Challenge in Japan.
Peter Corke, director of the Australian Centre for Robotic Vision at Queensland University of Technology, and other members of Team ACRV work on their robot, named Cartman, which won the 2017 Amazon Robotics Challenge in Japan.
Photo: Anthony Weate/QUT

Amazon has a problem, and that problem is humans. Amazon needs humans, lots of them. But humans, as we all know, are the most unreasonable part of any business, constantly demanding things like lights and air. So Amazon has turned to robots (over 100,000 of them) for doing tasks like moving things around in a warehouse. But it’s proving to be much more difficult to get the robots to do some other tasks. One of the hardest is picking objects from shelves and bins.

To solve this problem, Amazon is making it someone else’s problem, by hosting a yearly robotics “picking” challenge. In the competition, teams have to develop robotics hardware and software that can recognize objects, grasp them, and move them from place to place. This is harder than it sounds, because we’re on year three and Amazon is still running this thing, but some clever Australians are making substantial progress.

What Amazon was looking for was a robot that could identify items, remove target items from storage and place them into boxes (picking), take target items from totes and place them into storage (stowing), and then do both at once in a grand fantastic explosion all-or-nothing final competition.

The 2017 incarnation of the Amazon Robotics Challenge was held at RoboCup in Nagoya last month, and sixteen teams from around the world made the trip to Japan. What Amazon was looking for was a robot that could identify items, remove target items from storage and place them into boxes (picking), take target items from totes and place them into storage (stowing), and then do both at once in a grand fantastic explosion all-or-nothing final competition.

Teams brought their own robots with their own nutty gripper designs, and also their own item storage system designed to be able to handle all of the stuff and junk that crazy people like you buy on Amazon every day. Points were awarded for successful picks, successful stows, neat packing, and overall quickness, while points were deducted for (among other things) “major damage” to items, which is unfortunate, since a robot that could just flatten everything into a pancake would have a much easier time at this!

Here’s an overview of how things went:

Team ACRV (from the Australian Centre for Robotic Vision at Queensland University of Technology in Australia), which didn’t place in the top three on either the individual pick task or stow task, managed to knock it out of the park on the combined final task, taking first place and going home with US $80,000 (which is way more in Australia). 

The team used a custom-made cartesian robot, named Cartman, with both a claw and suction gripper. Most other teams relied on articulated robotic manipulators. Cartman’s design gave the Australians “more flexibility to complete the tasks than most robots can offer,” said team leader Juxi Leitner, a robotics researcher at QUT. Cartman is robust and tackles the task in an innovative way and is also cost effective.

Third place went to Singapore’s Nanyang Technological University, which managed a first in the picking task and a second in the stowing task. And second place went to NimbRo, which posted this video of their final run:

A few things to note from these videos: It looks like most teams used some flavor of hybrid gripper design, relying primarily on suction and using a physical gripping mechanism when necessary. There are also plenty of instances when the first grasping attempt fails, and the robot needs to be able to detect and adapt to that, just like a human does.

Additionally, the robots sometimes grasped multiple things at once by accident, or had to deal with objects (like books) that can change their shape post-grasp as they were lifted. These sorts of things are why challenges like these are important: Given the number of objects that Amazon is foisting on us, it’s hard to predict how any system will perform without trying it out in real life, or as close to real life as challenges like these allow.

QUT team wins Amazon Robotics ChallengeThe Australian team used a custom-made cartesian robot with both a claw and suction gripper, a design that helped them win the competition.Photo: Anthony Weate/QUT

While QUT’s press release suggests that “the team has solved a key robotics problem for Amazon— picking items and stowing them in boxes in an unstructured environment,” that strikes us as awfully optimistic. It’s certainly a key robotics problem, but solving it implies a reliable robotic solution that can compete (at least to some extent) with a human picker, and based on these videos, we seem kind of far from that. Also worth noting is that QUT’s winning robot is a stationary gantry system, suggesting that Amazon could perhaps be open to a picking solution that doesn’t move, rather than a mobile manipulator. 

On the other hand, maybe we shouldn’t draw too many conclusions from the specific designs, and just be happy that we’re seeing some tangible advancements in object recognition, grasp planning, and everything else under conditions that are somewhat close to real-world usefulness. And as soon as Amazon buys up all the winning teams of one of their challenges and then cancels the following year, we might be able to actually figure out what their robotics fulfillment plan is.

[ Amazon Robotics Challenge ]

The Conversation (0)

The Bionic-Hand Arms Race

The prosthetics industry is too focused on high-tech limbs that are complicated, costly, and often impractical

12 min read
Horizontal
A photograph of a young woman with brown eyes and neck length hair dyed rose gold sits at a white table. In one hand she holds a carbon fiber robotic arm and hand. Her other arm ends near her elbow. Her short sleeve shirt has a pattern on it of illustrated hands.

The author, Britt Young, holding her Ottobock bebionic bionic arm.

Gabriela Hasbun. Makeup: Maria Nguyen for MAC cosmetics; Hair: Joan Laqui for Living Proof
DarkGray

In Jules Verne’s 1865 novel From the Earth to the Moon, members of the fictitious Baltimore Gun Club, all disabled Civil War veterans, restlessly search for a new enemy to conquer. They had spent the war innovating new, deadlier weaponry. By the war’s end, with “not quite one arm between four persons, and exactly two legs between six,” these self-taught amputee-weaponsmiths decide to repurpose their skills toward a new projectile: a rocket ship.

The story of the Baltimore Gun Club propelling themselves to the moon is about the extraordinary masculine power of the veteran, who doesn’t simply “overcome” his disability; he derives power and ambition from it. Their “crutches, wooden legs, artificial arms, steel hooks, caoutchouc [rubber] jaws, silver craniums [and] platinum noses” don’t play leading roles in their personalities—they are merely tools on their bodies. These piecemeal men are unlikely crusaders of invention with an even more unlikely mission. And yet who better to design the next great leap in technology than men remade by technology themselves?

Keep Reading ↓Show less