The October 2022 issue of IEEE Spectrum is here!

Close bar

Why Is Meta’s Metaverse Such a Misfire?

The virtual world’s most noteworthy spokesperson certainly isn’t helping the cause

3 min read
A selfie of Mark Zuckerberg's avatar in the metaverse platform Horizon Worlds.

Mark Zuckerberg's avatar doesn't look his best in Horizon Worlds.

Meta

Mark Zuckerberg isn’t a great ambassador for the metaverse.

Meta’s CEO kicked off another round of controversy with a screenshot celebrating the launch of Horizon Worlds, the company’s AR/VR metaverse platform, in France and Spain. Shot in the style of a selfie, it shows a poorly detailed rendition of Zuckerberg’s avatar staring past the camera. Crude 3D models of national landmarks sit behind him on a generic green landscape.

“It was a horrific PR move to put out those photos,” says Stu Richards (a.k.a. Meta Mike), partner success lead at GigLabs and cdofounder of Versed.


Meta’s metaverse hype leads to real-world backlash

Zuckerberg’s virtual selfie quickly went viral across numerous social media accounts. A tweet by user @ordinarytings, which claimed Horizon Worlds is “surely dying in the dark,” led the charge with more than 31,000 likes and over 4,500 quote tweets or retweets.

It’s not unusual for a tech CEO to receive a thrashing on Twitter, but the scale of the response–boosted by Mashable, The Daily Dot, and Kotaku–was suffocating. It’s hard to mount any defense of Meta’s ugly, simplistic screenshot. “I think the response is fair,” says Richards. “I’ve not been super impressed by what they’ve put out.”

Clearly, Zuckerberg’s post did not go as planned. But this raises the question: why?

“If they’re going to use game tech to build a VR game platform that’s supposed to be a cross between a Roblox-style UGC platform and a social MMO, maybe they should have people who have experience.”
—Rafael Brown, Symbol Zero

Rafael Brown, CEO of metaverse event company Symbol Zero and former game designer, thinks the company’s metaverse issues are rooted in difficulty keeping up with the level of fidelity common in the game industry.

“Facebook is out of touch with game-style software-development practices and expectations on art direction and character/avatar development,” says Brown. “Keep in mind their other internal projects like Quill, et cetera, that they’ve jettisoned and lost [staff over].”

Brown points out that Meta’s avatars have changed numerous times since the company’s purchase of VR hardware maker Oculus in 2014. These changes can be witnessed in other, past controversies, such as Zuckerberg’s ill-advised AR tour of Puerto Rico in the wake of Hurricane Maria. The avatars used then are different from today’s and radically different from the ghostlike avatars shown by Oculus in 2016.

This is how the Oculus avatars looked in 2016.www.youtube.com

There are other signs of instability. Meta’s VP of Horizon, Vivek Sharma, recently said he’s leaving the company for “a new opportunity.” Days later, the company announced it will shut down the Facebook Gaming app, a competitor to Amazon’s live-streaming platform Twitch, which eliminates an important avenue Meta could use to reach users.

“All I wonder is, if they’re going to use game tech to build a VR game platform that’s supposed to be a cross between a Roblox-style UGC platform and a social MMO, maybe they should have people who have experience,” says Brown. “They really need better art direction, technical art direction, game direction, and tools direction.”

Where does Meta go from here?

Zuckerberg tried to quell criticism with a follow-up post about a planned update to avatar graphics. It’s an improvement, to be sure. But the real glimmer of hope was shown at Siggraph, a computer graphics conference held in August of 2022.

A group of researchers from Reality Labs, Meta’s AR/VR research division, showed a paper titled “Authentic Volumetric Avatars from a Phone Scan,” which describes how smartphone photos with depth-of-field data can be paired with machine learning to achieve sharp, photorealistic results with accurate real-time facial animation. The detailed expressions shown by researchers at Reality Labs stands in stark contrast to the current state of Horizon Worlds’ avatars.

This video, demonstrating authentic volumetric avatars from a phone scan, was shown at Siggraph 2022.www.youtube.com

Richards notes that Meta’s current mainstream headset, the Meta Quest 2, may be partially responsible for the Horizon Worlds’ limitations. “[Meta is] building out tech that will have the mechanics in place to better focus on things like expression,” says Richards—but the affordable Quest 2 opted not to include sensors that can gauge users’ expression or track their eyes. “They’re trying to create adoption first. Once that happens is when they’ll focus more on integrating features.”

Meta might be ready to turn that corner with a headset to be announced at Oculus Connect 2022. While most details remain under wraps, Zuckerberg offered an early overview of its features during a recent interview on The Joe Rogan Experience.

Zuckerberg said the upcoming, yet unnamed headset will offer “the ability to now have eye contact in virtual reality, have your face be tracked so that your avatar is not just this still thing, if you smile, or you frown, or you pout, whatever your expression is, to have that actually in real time translate to your avatar.” His remarks sound a lot like what's already been shown at Siggraph and in other, earlier Meta research demos.

This could silence critiques of Horizon Worlds’ awkward, stilted graphical style—though only if it works as advertised.

The Conversation (3)
Payam Minoofar06 Sep, 2022
INDV

Meta's technical failures are important to cover, but the demise of the metaverse will likely stem from the fact that not enough people of means have sufficiently empty lives to jettison the real world for any form of a metaverse. IEEE's emphasis on the technical side of technology is understood, but it is high time that IEEE and other professional organizations weighed in on the social ramifications of technology. After all, we understand it best.

1 Reply
Keng-Yuan Chang04 Sep, 2022
INDV

I somehow think projecting real faces is still the way to go

Digging Into the New QD-OLED TVs

Formerly rival technologies have come together in Samsung displays

5 min read
Television screen displaying closeup of crystals

Sony's A95K televisions incorporate Samsung's new QD-OLED display technology.

Sony
Blue
Televisions and computer monitors with QD-OLED displays are now on store shelves. The image quality is—as expected—impressive, with amazing black levels, wide viewing angles, a broad color gamut, and high brightness. The products include:

All these products use display panels manufactured by Samsung but have their own unique display assembly, operating system, and electronics.

I took apart a 55-inch Samsung S95B to learn just how these new displays are put together (destroying it in the process). I found an extremely thin OLED backplane that generates blue light with an equally thin QD color-converting structure that completes the optical stack. I used a UV light source, a microscope, and a spectrometer to learn a lot about how these displays work.

Keep Reading ↓Show less