One of the biggest limitations of current VR technology is the inability to convey a realistic and complete sense of touch. So far, the most you would feel from a modern consumer VR system, like the HTC Vive, is vibration through a controller. From what we saw at SIGGRAPH 2016, it seems that the logical next step just is to produce more kinds of vibrations, at more points around the body, all synced with proper visuals and sound in VR.

Developers, researchers, and companies from around the world presented experimental haptic technologies at SIGGRAPH this week, ranging from novel hardware, to narrative experiences simply enhanced by a few vibrating units on your back.

Synesthesia Suit

One of the first things I tried was the Synesthesia Suit by researchers from Keio University. You may know it already as it was first seen in the demonstration of Rez Infinite on the PlayStation VR back in 2015. Now they’re back again showing off the suit with an additional VR experience they developed.

First I played Rez Infinite with the PSVR and the suit. It did seem to add more immersion, but ultimately did not make the game feel that much more real. Then I tried the other experience with a different suit running on the HTC Vive (an unnamed demo for show purposes) and it did actually impress me with how real some of it felt.

Synesthesia Suit haptics siggraph
The Synesthesia Suit exhibit

This other suit had differently placed vibrators on the suit than the first one I tried; there were even two on my head! The vibrators are actually voice coil based actuators, according to Kouta Minamizawa, the associate professor who worked on the suit, which are capable of a wide range of vibrations.

SEE ALSO
Meta is Deleting All Old Oculus Accounts by Month's End, Severing Another Tie to "the good old days"

The demo put me through several abstract scenes with similarly weird synthetic sound that reacts to what you do, or what happens to you. There were lasers hitting me, phantom beings passing through me, floating orbs of energy all throughout, and other random things. This time it was painfully clear—almost but not quite literally—that the vibration units on the suit were more capable of complex feedback than you’d think, from smooth buffets of energy, to sharp piercings of lasers. But there’s also another trick.

rez-suit
The configuration screen showing different haptic effects

The trick is in the synchronization of the right intensity vibrations with the right visuals and the right audio, which will be the key lesson to all of these projects. Without those ingredients, the haptics of the suit would simply feel like vibrations from a suit, not something actually touching you. That may be because the brain expects to feel a certain kind of feedback when seeing certain things happen to the body, or likewise expects something visually matching to understand better what’s being felt. Audio can also have a role in those expectations.

So if you’re missing any of those components, haptics can come off as fake. That may have been what was holding back Rez Infinite from showing off the full potential of the suit, since the game, at least in the demo I tried, didn’t have anything visually come into contact with my body in VR, so my brain wouldn’t have any context for what the vibration represents.

tactical-haptics-htc-vive
See Also: Hands-on – Tactical Haptics’ Vive Demo is Further Proof That VR Needs More Than Rumble

In the unnamed demo they had with the other suit, there was all manner of stuff touching and hitting me and it felt a lot more real; it showed me for the first time the potential for vibration-based body haptics in VR.

SEE ALSO
'Asgard's Wrath 2' Hands-on: The New Benchmark for Quest Games

Much of the time, however, it actually wasn’t very effective, as what I saw wasn’t exactly in sync with the vibrations. That was mostly because the suit didn’t actually do any body tracking, and just relied on assumptions of where my body would be, based on the position of the head and hands from the Vive. In the future that could change of course, as body tracking technology gets better and more widespread. Nonetheless, when it worked, it was on the verge of impressive. It truly felt like lasers were hitting my noggin at one point, and that’s a good thing, at least for now.

It’s true however that this concept, of higher realism with perfectly synchronized haptics, visuals, and audio, isn’t really new. It’s actually a rather simple and logical idea that has been proven for a long time. But with the rise of consumer VR technology and the new levels of ‘presence’ brought forth, the topic is more relevant than ever, to both researchers and businesses. In any case, many are attempting to reach for the holy grail of VR in their own way, and haptics is an important part in getting there.

Oculus HapticWave

oculus research hapticwave haptics siggraph

Work from the other researchers at SIGGRAPH reinforces this overarching concept of matched feedback. Especially Oculus Research’s ‘HapticWave’ project, a VR multi-sensory experiment with a vibrating metal plate. It essentially has users place their hand on a metal plate, put on an Oculus Rift, and control a bouncing ball, or a moving spark, on a table. The user would feel directional vibrations that mimic with a high degree of accuracy what is happening on the table and hear it happening with positional audio from the Rift’s headphones.

SEE ALSO
'Arizona Sunshine 2' Review – Head-popping Fun With Friends

When I tried it, it actually took a considerable amount of time to get used to the locked in calibration they had to set for efficient show demos, and in fact I had to try it several times, but when it worked for a few split moments, again, the objects did feel more physical rather than virtual. So it supports the idea that matched haptics, visuals, and audio, indeed were incredibly valuable together while not so much individually.

FOVeated-rendering-SMI-2
See Also: NVIDIA Says New Foveated Rendering Technique is More Efficient, Virtually Unnoticeable

We also can’t forget that Oculus, one of the biggest consumer VR players, is involved with HapticWave, and a few have questioned what they’re even doing with a such a bulky and kind of ‘useless’ metal plate. The answer is basically what most researchers presenting at SIGGRAPH would say: this is research to further our understanding of the field, not necessarily something that will be developed into a consumer product.

In this case, it would be to study the human perception of haptics, the limits, the effective baseline, etc. The HapticWave technology is partly a tool for making this possible, and one that will continue to advance as research is furthered. It’s also useful to keep in mind that Oculus Research, who created HapticWave, is a division at Oculus focused on technology that may be beneficial in the long term—5 to 10 out—so what they’re doing with HapticWave might just be a slice of the groundwork they’re setting.

Read the HapticWave Research Paper

Continue Reading on Page 2 >>

1
2
Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.


Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."
  • Steve Biegun

    I have to wonder if realistic haptic sensation is something that we as consumers would truly make use of. Many of the games we play involve some sort of action or danger. It makes me think of the promo for the Teslasuit that said “you can feel anything from a slight breeze to a gunshot,” which of course begs the question – “who would want to feel a gunshot?”

    • shoupart

      I think the appeal would be similar to people who like to play paintball or Airsoft, even when it involves the pain of getting shot with pellets.

    • Benjamin Outram

      Just reproduce nice sensations and not deadly ones! But I suppose there is also some satisfaction on inflicting pain maybe in a game..

      But the main thing I have learned from haptics is that even just vibration can be a powerful indicator to the mind that helps to stave off disbelief and help the mind to believe in the objective reality of virtual environments. It is exciting to think about what the coming years will bring.

      More information about the synesthesia haptic suit content and more of my work at benjaminoutram.com

    • brandon9271

      When they say “feel a gunshot” they obviously don’t mean feel an actual projectile rip through flesh and bone at 1,126 feet per second ;) Which, oddly enough happens so fast that many people don’t even know they’ve been shot until they see blood. It’s described by many as being hit by a hammer. I think it will be a long while before we have anything resembling real sensations and haptics will be crude vibrations for foreseeable future.

  • Benjamin Outram

    Benjamin Outram here. Thanks for covering the content I created for the full-body haptic vibration suit! Nice article.

  • David Christian

    VRhands.com

  • Gary

    Lolz combine this with a horror game and you have a deadly winner.