The Neural Network That Remembers

With short-term memory, recurrent neural networks gain some amazing abilities

12 min read
The Neural Network That Remembers
Illustration: John Hersey

“On tap at the brewpub. A nice dark red color with a nice head that left a lot of lace on the glass. Aroma is of raspberries and chocolate. Not much depth to speak of despite consisting of raspberries. The bourbon is pretty subtle as well. I really don’t know that find a flavor this beer tastes like. I would prefer a little more carbonization to come through. It’s pretty drinkable, but I wouldn’t mind if this beer was available.”

Besides the overpowering bouquet of raspberries in this guy’s beer, this review is remarkable for another reason. It was produced by a computer program instructed to hallucinate a review for a “fruit/vegetable beer.” Using a powerful artificial-intelligence tool called a recurrent neural network, the software that produced this passage isn’t even programmed to know what words are, much less to obey the rules of English syntax. Yet, by mining the patterns in reviews from the barflies at BeerAdvocate.com, the program learns how to generate similarly coherent (or incoherent) reviews.

Keep reading...Show less

This article is for IEEE members only. Join IEEE to access our full archive.

Join the world’s largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum’s articles, podcasts, and special reports. Learn more →

If you're already an IEEE member, please sign in to continue reading.

Membership includes:

  • Get unlimited access to IEEE Spectrum content
  • Follow your favorite topics to create a personalized feed of IEEE Spectrum content
  • Save Spectrum articles to read later
  • Network with other technology professionals
  • Establish a professional profile
  • Create a group to share and collaborate on projects
  • Discover IEEE events and activities
  • Join and participate in discussions

Nuclear Energy Brinkmanship in Ukraine

The Zaporizhzhia power plant is a strategically important prize, but war damage could be calamitous

6 min read
Barbed wire in the foreground frames a power plant in the distance across a wide river.

The Ukrainian-held city of Nikopol has been the target of frequent shelling by Russian invaders from the Zaporizhzhia Nuclear Power Plant, seen here from Nikopol, across the Dnipro River. Much of the Zaporizhzhia Region has been occupied by Russia since early in the war.

Dmytro Smolyenko/Ukrinform/Future Publishing/Getty Images

A battle of nerves and steel is raging at Europe’s largest nuclear power plant, which Russia captured in March. Russian forces use the Zaporizhzhia plant as a safe haven for troops and equipment, including artillery that is shelling Ukrainian-held territory directly across the Dnipro River. Ukraine is launching a counteroffensive to retake occupied territory, including Zaporizhzhia. And, all the while, each blames the other as explosions rock the nuclear site.

According to a Reuters report today, Russia’s Defense Department may order the plant to shut down, citing shelling damage to the plant’s “back-up support systems.” Yesterday most plant workers were allegedly told not to come to work tomorrow, according to Ukranian intelligence, which warns the Russians may be planning a dangerous “provocation.”

Keep Reading ↓Show less

Nvidia’s CTO on the Future of High-Performance Computing

The company’s Earth-2 supercomputer is taking on climate change

5 min read
portrait of Nvidia’s CTO, Michael Kagan on a gray background

Nvidia’s CTO Michael Kagan is an IEEE senior member.

Nvidia

In 2019 Michael Kagan was leading the development of accelerated networking technologies as chief technology officer at Mellanox Technologies, which he and eight colleagues had founded two decades earlier. Then in April 2020 Nvidia acquired the company for US $7 billion, and Kagan took over as CTO of that tech goliath—his dream job.

Nvidia is headquartered in Santa Clara, Calif., but Kagan works out of the company’s office in Israel.

Keep Reading ↓Show less

Harnessing the Power of Innovation Intelligence

Through case studies and data visualizations, this webinar will show you how to leverage IP and scientific data analytics to identify emerging business opportunities

1 min read
Clarivate
Clarivate

Business and R&D leaders have to make consequential strategic decisions every day in a global marketplace that continues to get more interconnected and complex. Luckily, the job can be more manageable and efficient by leveraging IP and scientific data analytics. Register for this free webinar now!

Join us for the webinar, Harnessing the power of innovation intelligence, to hear Clarivate experts discuss how analyzing IP data, together with scientific content and industry-specific data, can provide organization-wide situational awareness and reveal valuable business insights.

Keep Reading ↓Show less