The December 2022 issue of IEEE Spectrum is here!

Close bar

Yale’s Robot Hand Copies How Your Fingers Work to Improve Object Manipulation

These robotic fingers can turn friction on and off to make it easier to manipulate objects with one hand

4 min read
Yale GRAB Lab gripper with variable friction fingers
Yale's gripper uses servos to retract the low-friction, rigid finger surface [white smooth plastic], putting the object in contact with a high-friction deformable surface [yellow urethane rubber].
Photo: Yale GRAB Lab

In-hand manipulation is one of the things near the top of a very, very, verylong list of things that humans do without thinking that are extraordinarily difficult for robots. It’s the act of repositioning an object with one hand, usually with your fingers—you do it whenever you pick up a pen, for example, to switch from a “picking up” grasp to a “writing something” grasp. Next time you do this, pay attention to the intricate, coordinated motion that happens, and ask yourself just how in the world you could honestly expect a robot to do something similar.

And yet, robots are learning to do such things. For example, OpenAI recently taught a five-fingered hand to manipulate a cube, which is great, if you have a lot of patience and/or computing resources, and the budget for a fancy hand and stuff. For those of us without wealthy (and occasionally eccentric) patrons, a conventional gripper is a more realistic option, and researchers from Yale University’s GRAB Lab have developed a two-finger design with a clever variable-friction system that can do in-hand manipulation at a fraction of the cost.

“Our approach is quite different and uses a very simple hand setup and a very simple controller, but with finger surfaces inspired by the unique biomechanical properties of the human finger pads, which change their effective friction as normal force is increased,” says Ad Spiers, a former GRAB Lab researcher and now a research scientist at the Max Planck Institute for Intelligent Systems in Stuttgart, Germany. “This enables people to choose whether their fingers grip or slide over objects.”

The nice thing about your fingers is that you (probably) have bones in them, and they are (probably) surrounded by squishy tissue bits, and (hopefully) covered in textured skin. This is a phenomenal combination, since the bone lets you execute gripping force when you want to, while the skin and fat can maintain softer contact to let objects slide around. By using hard, friction-y contact in concert with softer sliding-y contact, you’re able to manipulate objects in all sorts of ways. Yale’s variable-friction fingers are an attempt to replicate this sort of functionality, through hardware that can turn friction on and off to alternate between gripping and sliding. 

It’s a fairly simple system, compensating for lack of complexity with clever design. The fingers are mostly 3D printed, with a molded elastomer friction-enhanced insert. The low friction bits are just ABS. The fingers can be either friction-y, slide-y, passively switchable by using downward force on an elastically suspended element, or actively switchable with the help of a servo. The cheapest and simplest way is to go with the passively switchable version, which still allows the gripper to adopt different manipulation modes, as the GRAB Lab group, led by Professor Aaron Dollar, describes in a recent paper: “Manipulating an object between the fingers with a low-torque reference enables object sliding [translation], while manipulating with a high-torque reference enables pivoting.”

Yale GRAB Lab gripperThe finger pushing the object (left) is torque controlled, while the other finger is position controlled and leads the motion. By changing the torque reference, you can engage the high and low friction surfaces to perform different manipulation behaviors.Image: Yale GRAB Lab

And if you have the budget for it, adding in those servos lets you do even fancier things, like rotating an object without translating it. In general, the gripper is able to achieve arbitrary object poses through in-hand manipulation, resulting in “a within-hand manipulation workspace beyond
the majority of the gripper designs in literature.” It seems like in order for this to be true you’d need a highly complex software controller or something, but it’s really not all that fancy, the researchers say:

An unsophisticated controller alternates between torque and position control for each finger, in order to maintain object grasp while also modulating grip force. This in turn varies finger surface friction to allow sliding, gripping and rolling of objects. The later addition of active fingers permits controlled sliding of [an] object on both fingers. This extends the capability of the hand and enables in-place rotation or proximal/distal transfer, for the fine positioning of objects within the gripper workspace.

The controller is open loop right now, but they’re working on a closed loop version that will allow the fingers to move objects into target poses, which will make the gripper much more useful. The researchers also suggest that the system they’ve come up with could relatively easily be integrated into other grippers to extend their capabilities.

Hopefully, this hardware will be miniaturized and combined with a variety of manipulation controllers to take advantage of other grasping techniques, like using a nearby surface for help (as shown in the video). Pure in-hand manipulation is cool, of course, but in a very practical sense, what’s important here is the objective: making it possible for robots to affordably and reliably do useful things in the real world, especially when it comes to things like prosthetics. And with that in mind, the researchers are in the process of open sourcing the design files to allow other folks to experiment with the hardware or develop more advanced controllers.

“Variable-Friction Finger Surfaces to Enable Within-Hand Manipulation via Gripping and Sliding,” by Adam J. Spiers, Berk Calli, and Aaron M. Dollar from Yale University, appears in IEEE Robotics and Automation Letters.

[ GRAB Lab ]

The Conversation (0)

The Bionic-Hand Arms Race

The prosthetics industry is too focused on high-tech limbs that are complicated, costly, and often impractical

12 min read
A photograph of a young woman with brown eyes and neck length hair dyed rose gold sits at a white table. In one hand she holds a carbon fiber robotic arm and hand. Her other arm ends near her elbow. Her short sleeve shirt has a pattern on it of illustrated hands.

The author, Britt Young, holding her Ottobock bebionic bionic arm.

Gabriela Hasbun. Makeup: Maria Nguyen for MAC cosmetics; Hair: Joan Laqui for Living Proof

In Jules Verne’s 1865 novel From the Earth to the Moon, members of the fictitious Baltimore Gun Club, all disabled Civil War veterans, restlessly search for a new enemy to conquer. They had spent the war innovating new, deadlier weaponry. By the war’s end, with “not quite one arm between four persons, and exactly two legs between six,” these self-taught amputee-weaponsmiths decide to repurpose their skills toward a new projectile: a rocket ship.

The story of the Baltimore Gun Club propelling themselves to the moon is about the extraordinary masculine power of the veteran, who doesn’t simply “overcome” his disability; he derives power and ambition from it. Their “crutches, wooden legs, artificial arms, steel hooks, caoutchouc [rubber] jaws, silver craniums [and] platinum noses” don’t play leading roles in their personalities—they are merely tools on their bodies. These piecemeal men are unlikely crusaders of invention with an even more unlikely mission. And yet who better to design the next great leap in technology than men remade by technology themselves?

Keep Reading ↓Show less