Physical Sensations in VR Go Hands-Free

This VR system manipulates the forearm to create sensations of touch

2 min read
A picture of a person's arm with a red and black device around their forearm. Arrows are drawn from their index finger and thumb to the device.

A new haptics system for VR users manipulates a person’s forearm, rather than the hand, to create physical sensations.

University of Electro-Communications

This article is part of our exclusive IEEE Journal Watch series in partnership with IEEE Xplore.

Virtual-reality headsets allow people to immerse themselves in a completely different environment, but some researchers are interested in expanding these fantasy worlds beyond just visual and acoustic sensations. For example, many groups have been searching for ways to incorporate touch sensation into VR.

One challenge around simulating physical touch, however, is the bulky hardware worn on the hands to emulate the sensations. This is especially true if the aim is to create physical sensations with multiple degrees of freedom (whereby sensations have different strengths and directions of force), because hardware would be needed to nudge the user’s hands from multiple angles.

Taha Moriyama is a researcher at the University of Electro-Communications, in Chofu, Japan. He has been captivated by the various VR systems such as HTC’s Vive, Oculus, and PlayStation VR since the products first hit the market.

“After experiencing VR in stores, amusement centers, and at friends’ houses, I thought it would be more impressive if I could actually touch and interact with VR objects,” explains Moriyama, who has been studying ways to incorporate haptics into VR ever since.

In his latest research with colleague Hiroyuki Kajimoto, he has developed a new approach to VR haptics that sidesteps the need for hardware on a user’s hands. Instead, haptics sensations are applied to the person’s forearm. The two describe this novel approach in a study published in IEEE Transactions on Haptics, in January.

The system can be 3D printed and weighs just 250 grams. It includes an external sensor camera that tracks the finger movements of the user. Haptics sensations are then applied to the top, bottom, or sides of the forearm to match the movements of the fingers. For example, moving a finger on a VR object to the left and right applies a left-right shear force to the forearm, and the system moves up and down in response to a finger’s up and down motion.

In their study, Kajimoto and Moriyama recruited 11 volunteers and assessed their comfort levels with the device while completing the simple task of grasping a VR object and moving it to a predetermined position.

“We were surprised that even with this new haptic presentation method, we were able to obtain a high comfort level without any training time,” says Moriyama.

Since the physical sensation is being applied to the forearm, it is perhaps not surprising that users reported the sensation as “symbolic” of moving a VR object, rather than feeling as though they were truly grasping a real object. However, the key advantage to this approach of manipulating the forearm is that it allows users to enjoy physical, hands-free VR sensations.

“In future work, we intend to design a device, based on our proposed device, that can present vibration and temperature,” says Moriyama.

This article appears in the July 2022 print issue as “Touchless Touching in VR.”

The Conversation (0)

3D-Stacked CMOS Takes Moore’s Law to New Heights

When transistors can’t get any smaller, the only direction is up

10 min read
An image of stacked squares with yellow flat bars through them.
Emily Cooper

Perhaps the most far-reaching technological achievement over the last 50 years has been the steady march toward ever smaller transistors, fitting them more tightly together, and reducing their power consumption. And yet, ever since the two of us started our careers at Intel more than 20 years ago, we’ve been hearing the alarms that the descent into the infinitesimal was about to end. Yet year after year, brilliant new innovations continue to propel the semiconductor industry further.

Along this journey, we engineers had to change the transistor’s architecture as we continued to scale down area and power consumption while boosting performance. The “planar” transistor designs that took us through the last half of the 20th century gave way to 3D fin-shaped devices by the first half of the 2010s. Now, these too have an end date in sight, with a new gate-all-around (GAA) structure rolling into production soon. But we have to look even further ahead because our ability to scale down even this new transistor architecture, which we call RibbonFET, has its limits.

Keep Reading ↓Show less