Toyota AI Team Hires James Kuffner from Google Robotics, Will Have Rodney Brooks as Adviser

Toyota Research Institute has announced its leadership team for AI and robotics research

4 min read
Toyota AI Team Hires James Kuffner from Google Robotics, Will Have Rodney Brooks as Adviser
Toyota Research Institute CEO Gill Pratt announced an impressive line-up of engineers and executives to head its technical leadership team and advisory board.
Photo: Toyota

Toyota revealed more details about its ambitious AI and robotics effort yesterday at CES in Las Vegas. Dr. Gill Pratt, who leads the effort as CEO of the newly formed Toyota Research Institute (TRI), announced an impressive line-up of engineers and executives to head its technical leadership team and advisory board. Among the hires is James Kuffner, who until recently led Google’s robotics program and will focus on cloud computing at TRI. The advisers include notable technologists like Rodney Brooks from Rethink Robotics and Marc Benioff from Salesforce.

Late last year, Toyota unveiled a US $1 billion program to advance AI and robotics, hoping to make cars safer and smarter, and also develop useful, reliable home robots to assist people. TRI established a research partnership with Stanford and MIT and will open offices near those institutions in Palo Alto, Calif., and Cambridge, Mass., respectively. The automaker, which apparently holds more autonomous car patents than any other company, says it has nearly 30 projects ready to be developed in collaboration with the Stanford and MIT researchers.

At CES, Dr. Pratt described the motivations that led to the establishment of TRI. One of its mandates is enhancing safety, with the ultimate goal of “creating a car that is incapable of causing a crash.” Other mandates involve increasing access to vehicles to people who cannot drive, developing mobility technology for indoor applications, and accelerating scientific discovery using AI and machine learning.

img From left: Gill Pratt, Larry Jackel, Eric Krotkov, James Kuffner, John Leonard, Hiroshi Okajima, Russ Tedrake, and Brian Storey. Photo: Evan Ackerman/IEEE Spectrum

He then introduced the initial members of the TRI technical team:

  • Eric Krotkov, Former DARPA Program Manager―Chief Operating Officer
  • Larry Jackel, Former Bell Labs Department Head and DARPA Program Manager―Machine Learning
  • James Kuffner, CMU Professor and former head of Google Robotics―Cloud Computing
  • John Leonard, Samuel C. Collins Professor of Mechanical and Ocean Engineering, MIT―Autonomous Driving
  • Hiroshi Okajima, Project General Manager, R&D Management Division, Toyota Motor Corporation―Executive Liaison Officer
  • Brian Storey, Professor of Mechanical Engineering, Olin College of Engineering―Accelerating Scientific Discovery
  • Russ Tedrake, Associate Professor in the Department of Electrical Engineering and Computer Science, MIT―Simulation and Control

After the presentation, we got a chance to speak with some of the team members. We asked James Kuffner, who was part of the original self-driving car team at Google and more recently led its scattered robotics division after Andy Rubin abruptly abandoned it in 2014, what he was looking foward to with his new position at TRI:

“It’s a great opportunity that’s more focused [than Google’s robotics program] and I do think that under Gill’s leadership we’ll be able to make a big difference. I feel that creating a new team and going for big goals with lots of unsolved research problems is something that keeps me going and I’ve been doing that for a couple years at Google and now I’m excited to explore some new technologies and learn a lot of new things.” 

We also spoke to MIT’s Russ Tedrake (who, along with MIT colleague John Leonard and Olin professor Brian Storey, will work part time with TRI while maintaining their university roles). Tedrake led the MIT team at the DARPA Robotics Challenge, and at TRI he plans to extend the research he was doing in his lab, focusing on robustness analysis of complex robotics, control, and vision systems:

“This is the best of both worlds for me. It’s the ability to do something big here with actually a direct connection to what I’ve been doing in lab.​ . . . I think that robotics is obviously in this huge upper trajectory but if things start failing, if people start realizing that your demos are not products, I think that the whole field could burst. So I think that robustness is the major thing separating academic research from product and this is chance to address that head-on.”

“Home robots may be even more personally prized in our future than cars have been in our past.”

In addition to a technical leadership team, TRI also assembled an advisory board, whose members include:

  • John Roos, former CEO of Wilson Sonsini and former U.S. Ambassador to Japan. Currently, General Partner at Geodesic Capital, a late stage venture capital firm and Senior Advisor at Centerview Partners, a preeminent mergers and acquisitions advisory firm―Chairman
  • Rodney Brooks, former director of the MIT Computer Science and AI Lab, founder of iRobot and Founder, Chairman and CTO of Rethink Robotics―Deputy Chairman
  • Marc Benioff, CEO of
  • Richard Danzig, Former U.S. Navy Secretary
  • Bran Ferren, former President of R&D at Walt Disney Imagineering and Chief Creative Officer of Applied Minds
  • Noboru Kikuchi (planned), Emeritus University of Michigan Professor, head of Toyota Central Research and Development Lab and the Toyota Research Institute of North America
  • Fei-Fei Li, director of the Stanford Artificial Intelligence Laboratory (SAIL)
  • Daniela Rus, director of MIT's Computer Science and Artificial Intelligence Laboratory

In his CES speech, Dr. Pratt explained that in the 1930s, Toyota, then a manufacturer of fabric looms, saw the revolutionary potential of automobiles and decided to enter the car industry, a bold move that proved immensely profitable. “It is entirely possible that robots will become for today’s Toyota what the car industry was when Toyota made looms,” he said. TRI will focus on mobility not only outdoors but indoors as well, a need “fueled by our aging society,” Dr. Pratt added. “Home robots may be even more personally prized in our future than cars have been in our past.”

[ Toyota ]

The Conversation (0)

How the U.S. Army Is Turning Robots Into Team Players

Engineers battle the limits of deep learning for battlefield bots

11 min read
Robot with threads near a fallen branch

RoMan, the Army Research Laboratory's robotic manipulator, considers the best way to grasp and move a tree branch at the Adelphi Laboratory Center, in Maryland.

Evan Ackerman

“I should probably not be standing this close," I think to myself, as the robot slowly approaches a large tree branch on the floor in front of me. It's not the size of the branch that makes me nervous—it's that the robot is operating autonomously, and that while I know what it's supposed to do, I'm not entirely sure what it will do. If everything works the way the roboticists at the U.S. Army Research Laboratory (ARL) in Adelphi, Md., expect, the robot will identify the branch, grasp it, and drag it out of the way. These folks know what they're doing, but I've spent enough time around robots that I take a small step backwards anyway.

This article is part of our special report on AI, “The Great AI Reckoning.”

The robot, named RoMan, for Robotic Manipulator, is about the size of a large lawn mower, with a tracked base that helps it handle most kinds of terrain. At the front, it has a squat torso equipped with cameras and depth sensors, as well as a pair of arms that were harvested from a prototype disaster-response robot originally developed at NASA's Jet Propulsion Laboratory for a DARPA robotics competition. RoMan's job today is roadway clearing, a multistep task that ARL wants the robot to complete as autonomously as possible. Instead of instructing the robot to grasp specific objects in specific ways and move them to specific places, the operators tell RoMan to "go clear a path." It's then up to the robot to make all the decisions necessary to achieve that objective.

Keep Reading ↓ Show less