Creating Recipes with Artificial Intelligence

IBM’s cognitive computing team takes on a new frontier: meal planning

3 min read
Creating Recipes with Artificial Intelligence
Photo: David Yellen

Now that Watson, IBM’s “Jeopardy!”-winning cognitive computing system, has left the game show circuit behind, it’s finding ample use for its talents in health care, finance, and other industries. Watson has quite a knack for combing through vast troves of data to find a fact or recommend a course of action based on knowledge and past experience.


And back at IBM’s Thomas J. Watson Research Center, in Yorktown Heights, N.Y., a research group led by electrical engineer and computer scientist Lav Varshney is pushing Watson to the next level. Varshney and his team don’t want a system that digs up a preexisting answer; they want to build a creative system, one that can come up with something new. And they want that something to be tasty.

Working with chefs at the Institute of Culinary Education in New York City, the IBM team is building a cognitive computing system that, given plenty of data about what foods most people already like, will be able to come up with inventive, delicious flavor combinations—far beyond the familiar pairings of tomato and basil, chocolate and strawberry, chicken and rosemary.

Recipe-generating programs already exist, but they are generally simple and case based, substituting new ingredients based on flavors that have worked well in other dishes. The IBM project is trying for something much harder: a system that comes up with radically new dishes based on combinations of ingredients and flavors that people would probably find appealing but may never have been put together in a dish before.

Here’s how it works. To begin, Varshney [left, in photo] and his team set up a large database of recipes from cookbooks, online recipe banks, and even the U.S. Navy (which, though not renowned for gourmet fare, makes some of its recipes publicly available). This collection is what’s known as an inspiration database, a pool of existing creative endeavors—recipes, in this case—that the system can draw from. “Then you can do a lot of transformations on those recipes,” Varshney says. “You can take two different recipes and mix them together; you can substitute ingredients; you can change the cooking processes.” The system takes those alterations as inputs, and then it knits together new recipes until it has—depending on available computing power—“a million or a billion or however many you want.”

But of those myriad recipes, many would likely prove unappetizing, and few would be both delectable and novel. So the system’s next and biggest challenge is to sort the wheat from the chaff—or perhaps the anise-infused wheat-berry salad from the nopal-cactus-and-halibut kebabs.

To do this, it first evaluates the taste-imparting molecules in each new combination of ingredients. Such flavor compounds might include, say, the fruity allyl propionate or coumarin, a chemical in green vegetables that has been described as “the taste of green.” The program then approximates what the newly meshed flavors taste like by comparing their component chemical structures with similar mixtures already in the database. To determine whether a new taste is appealing, the program is armed with a large body of research that has measured how much people like the flavors imparted by different combinations of compounds. If people tend to enjoy flavor combinations that are chemically similar to the new one, the computer can deduce that they’ll probably take pleasure in it, too.

To determine which flavor blends are truly novel, the system simply checks them against existing ones. Some mixtures will be entirely new, not found anywhere in the system’s database of recipes; others could be new within the context of a particular cuisine. For instance, they might introduce flavor pairings found in Indonesian food to an American-style dish.

Once the system has homed in on a promising recipe, Florian Pinel [right, in photo], a member of Varshney’s team who is both a software engineer and a professionally trained chef, will sometimes whip up a batch. “Last year we had a few things that were pretty good, like a turmeric-and-ginger grilled eggplant sandwich with a berry sauce,” Varshney recalls.

The system is still experimental, but Varshney is already envisioning real-world uses. Could it help improve school lunch menus? Definitely, he says. Could it create a range of recipes low in salt and fat for people with cardiovascular disease? No problem. What about dinners for a lactose-intolerant diabetic looking to incorporate specific seasonal produce into her diet? Eventually, Varshney believes. “Here you can create whatever you want under the constraints you set, rather than just having to work with what’s already there,” he declares.

But the biggest limitation of IBM’s approach may be that it oversimplifies the pleasures of eating. Our opinion of a meal is shaped by our feelings and memories, the people surrounding us, and the textures and presentation of the food in front of us—all things that are hard to capture in an algorithm.

Nevertheless, it’s clear that Varshney’s system is on track to create an inexhaustible recipe book of mouth-watering, never-before-tasted dishes. This artificial intelligence could very well prove that computers can outcompete humans at yet another cognitive craft we thought we alone had mastered.

This article originally appeared in print as “IBM’s Taste Master.”

The Conversation (0)

Q&A With Co-Creator of the 6502 Processor

Bill Mensch on the microprocessor that powered the Atari 2600 and Commodore 64

5 min read
Bill Mensch

Few people have seen their handiwork influence the world more than Bill Mensch. He helped create the legendary 8-bit 6502 microprocessor, launched in 1975, which was the heart of groundbreaking systems including the Atari 2600, Apple II, and Commodore 64. Mensch also created the VIA 65C22 input/output chip—noted for its rich features and which was crucial to the 6502's overall popularity—and the second-generation 65C816, a 16-bit processor that powered machines such as the Apple IIGS, and the Super Nintendo console.

Many of the 65x series of chips are still in production. The processors and their variants are used as microcontrollers in commercial products, and they remain popular among hobbyists who build home-brewed computers. The surge of interest in retrocomputing has led to folks once again swapping tips on how to write polished games using the 6502 assembly code, with new titles being released for the Atari, BBC Micro, and other machines.

Keep Reading ↓ Show less

Spot’s 3.0 Update Adds Increased Autonomy, New Door Tricks

Boston Dynamics' Spot can now handle push-bar doors and dynamically replan in complex environments

5 min read
Boston Dynamics

While Boston Dynamics' Atlas humanoid spends its time learning how to dance and do parkour, the company's Spot quadruped is quietly getting much better at doing useful, valuable tasks in commercial environments. Solving tasks like dynamic path planning and door manipulation in a way that's robust enough that someone can buy your robot and not regret it is, I would argue, just as difficult (if not more difficult) as getting a robot to do a backflip.

With a short blog post today, Boston Dynamics is announcing Spot Release 3.0, representing more than a year of software improvements over Release 2.0 that we covered back in May of 2020. The highlights of Release 3.0 include autonomous dynamic replanning, cloud integration, some clever camera tricks, and a new ability to handle push-bar doors, and earlier today, we spoke with Spot Chief Engineer at Boston Dynamics Zachary Jackowski to learn more about what Spot's been up to.

Keep Reading ↓ Show less

How to Write Exceptionally Clear Requirements: 21 Tips

Avoid bad requirements with these 21 tips

1 min read

Systems Engineers face a major dilemma: More than 50% of project defects are caused by poorly written requirements. It's important to identify problematic language early on, before it develops into late-stage rework, cost-overruns, and recalls. Learn how to identify risks, errors and ambiguities in requirements before they cripple your project.

Trending Stories

The most-read stories on IEEE Spectrum right now