Dream Jobs 2011: Play It Again, Sergei

John Q. Walker brings back the sounds of musical greats

4 min read
Photo: D.L. Anderson

dream jobs link box

John Q. Walker II


AGE 54

Develops technology to re-create musical performances.

Zenph Sound Innovations

where he doeS It
Durham, N.C.

Brings great musicians back to life—almost.

This profile is part of IEEE Spectrum's Special Report on Dream Jobs 2011.

When John Q. Walker was a teenager, his parents had him take piano lessons from one of their friends, a middle-aged woman who lived down the street.

That was a fortunate arrangement.

Ruth Slenczynska was no run-of-the-mill piano teacher. As a child prodigy, she had studied under Sergei Rachmaninoff, the famous Russian pianist, composer, and conductor, who died in 1943.

During lessons, the young Walker often heard Slenczynska say, "Now, that’s not how Mr. Rachmaninoff would have played it." That got him thinking: Could he figure out, in full quantitative detail, how Rachmaninoff would have played a piece? Decades later, Walker is still on that quest. And he’s having a blast.

Exploring his dual interests, he earned bachelor’s degrees in music and mathematics, and later he added a master’s degree in computer science, all from Southern Illinois University at Edwardsville, where Slenczynska was an artist in residence. He eventually received a doctorate, too, in software engineering, from the University of North Carolina at Chapel Hill. By that point, though, piano was more of a sideline than a possible vocation. "I was a natural who never practiced, so I was never very good," he says.

Walker spent 17 years working at IBM, principally in North Carolina’s Research Triangle Park, before starting a company called Ganymede Software with his colleague Peter Schwaller and two other engineers in 1995. Their software measured how fast computer networks pass data around. It was good timing: The following year the International Telecommunication Union began drawing up the first standards for voice communications over Internet Protocol. Because Ganymede’s software could help telecom providers determine how well their networks handled VoIP calls, the new company quickly took off. Its founders had equally good timing when they sold Ganymede, on 10 March 2000—the very day NASDAQ hit its peak.

Flush with cash and optimism, Walker could now pursue his teenage dream of reproducing the musical style of Rachmaninoff. Partnering with Schwaller again, he invested in a Yamaha Disklavier Pro, a robotic concert grand piano that can precisely play music fed to it in digital form. The two spent a year reverse engineering this exquisitely built but poorly documented machine. Then they turned to the even harder task of translating old musical recordings into digitized descriptions of exactly how each of the notes was played. Along the way, they hired a handful of other accomplished computer scientists with musical backgrounds for their new company, Zenph Sound Innovations.

To tackle that problem, they needed to transform music from raw audio into a digitized series of accurately described notes. Existing transcription software allowed a composer to transcribe noodlings at the keyboard, but it couldn’t capture all the nuances of a great piano performance—the careful timing of the sostenuto pedal, the measured touch of a quiet staccato note, the almost imperceptible pause between some musical phrases. That’s what the Zenph team set out to accomplish.

"We spent months and months on ’Mary Had a Little Lamb,’ " recalls Walker. Eventually they could encode digitally every detail of an extraordinarily complex piano performance: Glenn Gould’s 1955 recording of Bach’s Goldberg Variations. Although it wasn’t even recorded in stereo at the time, it remains one of the best-selling classical recordings ever.

In 2006 Walker and his colleagues arranged a meeting with the president of Sony Music Entertainment. They handed him a copy of the standard recording of Gould’s Goldberg Variations—to which Sony owns the rights—followed by their version of the same piece, done on the Yamaha Disklavier Pro using data that Zenph extracted from Gould’s original. It took the Sony president all of 3 minutes to go from "Who are these guys?" to "That’s fantastic—let’s do business," says Walker.

After clinching a deal with Sony, Zenph engineers continued to show off their technology by re-creating the playing of other famous musicians. "Reperformance" is what Walker calls the process. "We had to invent the word—so we did," he says.

Eventually, Walker says, he’ll have software to analyze many recordings and define the attributes that make one pianist different from another. At that point, it will be possible to create a virtual Gould or a virtual Rachmaninoff and to have a modern instrument play in their styles pieces these musicians never performed—a notion that might leave some music aficionados aghast but others delighted. "Here’s a different way to preserve an artist," Walker says, "in how they played."

And Walker isn’t going to stop with the piano. His team has already created reperformances of jazz bassists such as the late Ray Brown. Rather than attempting to do that robotically, Zenph synthesizes the sounds of a plucked bass using a very high-tech transducer that’s about as tall and wide as a string bass. "Now we’ve got Ray Brown in a can," quips Walker. He intends to work this way through a progression of instruments, ultimately even the human voice.

Zenph has other interesting services in mind as well. "You could upload to our Web site your daughter’s fourth-grade piano recital, and it would come back on a Steinway at Carnegie Hall," Walker says with a grin. The promise that computerized audio will soon do for music what computer graphics has already done for film gives Walker a huge charge, and the 54-year-old gushes with a teenager’s enthusiasm when he discusses the company’s future plans.

With its latest infusion of venture capital, Zenph recently opened a new office in Durham, N.C. Before that, most of the work was done around the kitchen table of Walker’s elegant Raleigh home, steps away from an 8- by 11-meter music studio he added to the house to hold Zenph’s high-tech instruments. He designed the space after one that the 19th-century composer Richard Wagner built at his home in Bayreuth, Germany. Walker’s former piano teacher, Slenczynska, occasionally helps with such tasks as choosing which concert grands to buy.

It’s obvious how much pleasure this high-tech business provides Walker. You can hear it in his laugh when he describes the marvelous things Zenph has done or is planning to do. So it’s clearly a rhetorical question when the musician and computer scientist asks, "This is a dream job—isn’t it?"

An abridged version of this article appeared in print as "Play It Again, Sergei."

To Probe Further

For more articles and special features, go to Dream Jobs 2011.

The Conversation (0)

This Huge DIY Workbench Gives You a Hand

A little bit of automation and a lot of space makes projects easier

4 min read
James Provost

As an avid experimenter and builder of random contraptions—and who isn't the best at putting his tools away and normally has multiple projects in various stages of completion—I often run out of work space. So I decided to build a new workbench. One that would be better, not just because it was bigger but because it would be smarter. A bench that could automatically assist me in getting things done!

In my garage I previously had two main work spaces: a 183-by-76-centimeter butcher block that also houses a small milling machine, and a custom 147-by-57-cm work space with a built-in router that pops out as needed. Though this space is generous by most standards, it seems I always needed “just a bit" more. After some consideration, I purchased a 2x4basics custom workbench kit (which provides the bench's heavy-gauge structural resin supports) and lumber to form the main structure, and then cut slabs of chipboard to form a top and a bottom surface.

Keep Reading ↓ Show less

We Don’t Need a Jetsons Future, Just a Sustainable One

“Cozy futurism” reimagines tech for the greater good

3 min read

For decades, our vision of the future has been stuck in a 1960s-era dream of science fiction embodied by The Jetsons and space travel. But that isn't what we need right now. In fact, what if our vision of that particular technologically advanced future is all wrong?

What if, instead of self-driving cars, digital assistants whispering in our ears, and virtual-reality glasses, we viewed a technologically advanced society as one where everyone had sustainable housing? Where we could manage and then reduce the amount of carbon in our atmosphere? Where everyone had access to preventative health care that was both personalized and less invasive?

Keep Reading ↓ Show less

McMaster Engineering: Transforming Education and Fostering Research With Impact

By adding new faculty and developing innovative approaches to its curriculum, McMaster solidifies its world leading position in engineering

3 min read

The Faculty of Engineering at McMaster University in Hamilton, Ont., Canada is aiming to build on its ranking as one of the world's top engineering schools by expanding its recruitment of both tenure-track and teaching track positions across multiple departments. This broad initiative is expected to continue the growth of McMaster as a leading destination for innovative teaching and research.

Keep Reading ↓ Show less

Trending Stories

The most-read stories on IEEE Spectrum right now