Dexta’s exoskeleton glove is a haptic input system which is designed to give users a sense of touch in VR. These new videos which show how the company’s ‘Dextarity Interaction Engine’ gives developers the tools they need to get the virtual world to push back.

The subtleties of a our sense of touch is taken for granted most of the time, you’re unlikely to have given much thought as to just how much information can be passed on through infinitely subtle interactions our fingers and hands have with real world objections. Dexta’s Dexmo exoskeleton gloves are designed to emulate those subtleties, to help add not only immersion to virtual reality experiences, but to give the user that naturalistic, human, tactile guiding force we take for granted in reality, but miss horribly when it’s gone in VR.

We wrote recently on Dexmo’s exoskeleton gloves, quizzing Dexta Robotic’s CEO Aler Gu on what makes Dexmo tick from a hardware perspective, briefly touching upon development APIs. Now, Dexta have released two new videos which demonstrate what they’re calling ‘Dextarity Interaction Engine’ (DexIE for short), an extended set of developers tools and algorithms which define a sort of haptic language for which devs can communicate events, interactions and help to build a virtual physical interface of sorts.

One of the bigger issues when your mind is immersed in a virtual space, and with your hands actions faithfully reproduced, it’s jarring when you’re virtual avatar passes through objects that have no physicality on the virtual plane. DexIE provides options for developers to give solidity to those objects, by ‘preventing’ your fingers physical position penetrating the mesh of a polygonal object.

SEE ALSO
Pico Reportedly Cancels Quest Competitor to Instead Take on Apple Vision Pro

Dexta CEO Aler Gu, speaking to us via email says “The guiding principle in hand interaction is that the mesh of hands and objects shouldn’t penetrate each other. Once our brain observe that, it will immediately know it’s not real. And that really breaks the immersion,” adding, “There are also a lot of the problems which only appear when you have the right hardware for it. For example, when you are using the Vive controller to pick something up, there is no physics. You are basically ‘sticking’ the object using 2 sets of 3d coordinates.”

dexmo-prototype-8

With Dexmo however, Dexta thinks their device makes all the difference, Gu tells me that “There are multiple contact points that actually performs physical interaction with 3d objects, which is why “switch between hands interaction” is actually very difficult to implement. Fortunately our engineers found a way to solve that problem after all. We also have an “Object selection indicator” and “Invalid interaction Indicator” to help further improve the user experience.”

Dexmo gloves are, naturally, limited in that they can only enact opposing force to your hand’s digits and only within a certain range. But Dexta believe that their “complex algorithms” go a long way to give VR users that instant hand-object collision notification.

Elsewhere the haptic events are more subtle; Emulating the physical ‘click’ of a button or switch, or conveying the weight of an object playfully flipped by your fingers for example. Then there’s the downright useful tactile sizing of objects interacted with, for example picking up a screw, sensing its dimensions before fitting it to a nearby table.

SEE ALSO
How to Measure Your IPD and Why It's Important for VR & AR Headsets

Gu tells us what they aimed to convey with the above video:

This is a parallel comparison between Vive and Dexmo for certain common tasks in VR. The user is requested to pull a lever, turn a knob, and press some buttons. Dexmo can simulate the physical presence of the lever, knob and the different layers of stiffness for the buttons. When the force feedback is combined with the sound, graphics, it really leaps to the next level of immersion.

We have had a total of 40 volunteers trying out this demo, and 100% of them agreed that Dexmo provides a more immersive VR experience. Another thing we have observed during our user studies is that, when people are using the Vive, we have to teach them how to use Vive controllers to operate the widgets; With Dexmo, it is very natural and intuitive. People reach out their hands and it just works. we don’t have to say anything. So that was a really encouraging feedback for us.

The demo you are seeing in the video is actually made by one of our software engineers who spent only 3 month playing with Unity. You can imagine the magical experience that developers with 5 years of experiences can pull out with this Device!

It’s undeniably all very cool. However we still have questions over cost, tracking and availability to market. Some which we touched upon in our recent interview with Aler Gu. It’s also another example of a peripheral that will require specific software integration in order to reach its potential, which is why these videos are important of course – proving to potential developer partners that Dexta have already done a lot of hard work for them.

Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.


Based in the UK, Paul has been immersed in interactive entertainment for the best part of 27 years and has followed advances in gaming with a passionate fervour. His obsession with graphical fidelity over the years has had him branded a ‘graphics whore’ (which he views as the highest compliment) more than once and he holds a particular candle for the dream of the ultimate immersive gaming experience. Having followed and been disappointed by the original VR explosion of the 90s, he then founded RiftVR.com to follow the new and exciting prospect of the rebirth of VR in products like the Oculus Rift. Paul joined forces with Ben to help build the new Road to VR in preparation for what he sees as VR’s coming of age over the next few years.
  • The SDK seems cool. Anyway the last part of the article is the most important: cost, availability… are still unknown. About the comparisons with Vive… it’s obvious that is more intuitive… no test would be needed to understand this…

    • David Herrington

      Actually, about the comparisons with Vive controllers, I think it is necessary to talk about them, as “similar” tests using only the subjects hands, like in tests with the Leap Motion, can actually be WORSE than using a controller as there was no real substance to grip or feel. For instance, wielding a gun or sword when using a controller was preferable than holding nothing as the player can connect to this real item despite the weight or balance being off. Something real in hand is better than nothing in those cases.
      However, this study shows that you can place whatever thing in the hand using the Dexmo and still feel connected. That’s pretty amazing. The one thing I totally agree with you about is how much more immersive it is versus the price… I mean vive controllers are free…

      • Agree with what you say… but I’ve said something different. It’s ok to test controllers vs leap-motion-like things, because they offer different advantages. But if you test two different physical controller, one that is a standard controller and the other that is a super-cool hand exoskeleton… and you also test them with a program made for the exoskeleton, the results are pretty obvious.

      • DiGiCT Ltd

        Indeed it let you feel the shape you grab only, nothing more than that.
        It can be for sure feel good in the hand compared to any other controller.
        but it will not work if you hold the object with 2 hands, like e.g a ball as you still can bring those hands together.
        It has no postion locks for you hands but only has finger.
        It looks still very clumsy and does not look worth buying for games at all.

        The only purpose i could imagine for it is to use it for VR based robot arm control for more advanced kind of equipment remote controlled via VR.
        In that area for enterprise VR solution it has a strong future for this tech

        but for end consumers I cant see it become useful yet.

  • Outer Limits

    They should totally do a Virtual Digital Piano demo with this to really show off the individual finger motion :)

  • DiGiCT Ltd

    Its a nice concept but very limited to only what is inside your handpalm and below your finger only.
    It requires more to get it done full as an exoskeleton does.

    You can swipe just trough objects there is no locking on elbows or shoulders etc only hand.
    It add a little extra but im wondering if that really worth buying it at the end..

  • Tracking will, most likely, be from the Steam Lighthouse tracking chips they recently opened up to other developers and manufacturers. Right? Why bother with anything else?