The December 2022 issue of IEEE Spectrum is here!

Close bar

Spherical Display Lets You See 3-D Animations from Any Angle

Spheree uses microprojectors to create interactive objects on a round surface

2 min read
Spherical Display Lets You See 3-D Animations from Any Angle
Image: The University of British Columbia

Researchers from the University of São Paulo, in Brazil, and University of British Columbia, in Canada, have developed a spherical display that lets users see and interact with three-dimensional objects. In one demonstration, viewers have the sensation of staring into a snow globe that they can control with simple gestures from any angle.

The device, called Spheree, represents the first display capable of projecting uniform, high resolution pixels on a spherical surface—a technology that also allows users to interact with the 3-D display objects by using gestures.

The Spheree allowed attendees at the SIGGRAPH 2014 convention held in Vancouver last week to play with a Snow Globe 3D animation that included a house, animated snow and a train chugging around the house. That interactive display required eight pocket-size projectors mounted at the base of the globe, as well as software capable of blending together the individual projector views to create a uniform pixel presentation from almost anywhere on the spherical surface.

Small pico-projectors like the ones used for the demonstration have lower resolution and brightness than traditional projectors—a problem for a virtual reality system that aims for high quality. But the international team of Brazilian and Canadian researchers used an auto-calibration algorithm called FastFusion to seamlessly combine the resolution and brightness of the many projected images without a resulting decrease in quality. A basic webcam allows the algorithm to see the position of the individual projector images on the globe and compute each image's contribution to the overall final image.

The auto-calibration system works with practically any number of pico-projectors, which means researchers could build ever-larger versions of Spheree. The team has already tested a four pico-projector system with an 18-centimeter-wide display and an eight pico-projector system with a 51-centimeter-wide display. By avoiding the use of special mirrors or lenses, they avoided having "blind spots" in the overall projected image.

Spheree also uses six infrared cameras to track the movement of special headbands worn by viewers. The  data the cameras feed to a computer constantly provide perspective-corrected virtual scenes based on a viewer's position with respect to the globe. Gesture control with a Leap Motion interface also allows users to interact with the 3-D scenes or animations by using gestures to start, move forward and backward, pause and stop animations.

The system uses a second computer to run 3-D animations with Blender Software. Researchers envision Spheree helping animators or modelers by showing 3-D computer animations or the results of image-based rendering applications—perhaps as a second screen. A larger version of Spheree might provide walk-around experiences for team projects or show up in interactive museum displays. Future video games or toys might also make use of such technology.

Spheree contributors: University of British Columbia, Canada; Universidade Federal do ABC (UFABC), Brazil; Federal University of São Carlos (UFSCar), Brazil; and University of Saskatchewan, Canada.

The Conversation (0)

Deep Learning Could Bring the Concert Experience Home

The century-old quest for truly realistic sound production is finally paying off

12 min read
Image containing multiple aspects such as instruments and left and right open hands.
Stuart Bradford

Now that recorded sound has become ubiquitous, we hardly think about it. From our smartphones, smart speakers, TVs, radios, disc players, and car sound systems, it’s an enduring and enjoyable presence in our lives. In 2017, a survey by the polling firm Nielsen suggested that some 90 percent of the U.S. population listens to music regularly and that, on average, they do so 32 hours per week.

Behind this free-flowing pleasure are enormous industries applying technology to the long-standing goal of reproducing sound with the greatest possible realism. From Edison’s phonograph and the horn speakers of the 1880s, successive generations of engineers in pursuit of this ideal invented and exploited countless technologies: triode vacuum tubes, dynamic loudspeakers, magnetic phonograph cartridges, solid-state amplifier circuits in scores of different topologies, electrostatic speakers, optical discs, stereo, and surround sound. And over the past five decades, digital technologies, like audio compression and streaming, have transformed the music industry.

Keep Reading ↓Show less