While it’s exciting to start seeing 6DOF standalone VR headsets like the Vive Focus and Mirage Solo, both unfortunately include a 3DOF controller which in many cases functions as an immersion barrier compared to a fully 6DOF VR system. Today at its Vive Ecosystem Conference 2018 in China, HTC said that the 3DOF Vive Focus controller will see a 6DOF mode, and further said that the headset will soon include controller-less hand-tracking for gesture input.

3DOF to 6DOF Controller Upgrade

Following interesting research from Google on the topic of 3DOF controllers being used for 6DOF input with the aid of on-board cameras and some computer-vision processing, HTC today teased that the Vive Focus controller could be used as a 6DOF controller by leveraging the headset’s on-board cameras and the company’s “proprietary AI computer vision technology.”

The Windows VR headsets also use their on-board cameras to track their controllers, but have the advantage of the controllers being covered in LEDs to give the cameras a much easier target to track. When it comes to the Vive Focus’ simple 3DOF controller, it seems more complex computer vision processing would need to be employed considering that the device lacks and explicit tracking markers. Presumably HTC also has the option of launching a new Focus controller with markers for enhanced accuracy, though the company says that being able to roll out a 6DOF mode for the controller without additional cost to end-users is a key benefit of their approach—though it isn’t clear strategically why the company waited until after the headset’s launch to add such a game changing (literally) feature.

After Management Shuffle, HTC Says VR/AR More Important Than Ever to Its Future

Similar to the Windows VR headsets, tracking of the controller can only be done when the controller is inside the field of view of the cameras, so the 6DOF tracking area will largely depend on the area which the Focus’ cameras can see. Outside of that area, the position of the controllers can be inferred from the IMU, but this becomes inaccurate quickly, making games where players hands aren’t always in front of them potentially problematic for such tracking. Key to making this kind of controller tracking feel decent will be how quickly the system can relocate an accurate controller position once it comes back into view.

HTC has also confirmed to Road to VR that the Vive Focus’ new PC VR streaming functionality will eventually also support the 6DOF controller tracking mode.

Hand-tracking for Gesture Input

In addition to the 6DOF mode for the Vive Focus controller, HTC has announced that developers will soon be able to use gesture recognition in their applications thanks to hand-tracking through the Vive Focus’ cameras. HTC tells Road to VR that this function is specifically for coarse gesture recognition, not finger-level tracking like you might expect from something like Leap Motion. The company says it will launch the gesture recognition SDK to Viveport developers in the coming weeks.

Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.

Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."
  • Adrian Jakubiak

    Is it Vive hype train in background? It should look more like scrap-metal. Its dead.

  • JJ

    This is epic!

  • Sponge Bob

    I don’t get it

    Why is it so difficult to add just one IR LED to controller to facilitate future tracking applications BEFORE commercially releasing controllers to the public ?
    They did it before with useless camera on HTC Vive (and somewhat useful 2 cameras on HTC Vive Pro)
    Google’s “research” is crap anyway

    Does HTC know what they are doing ?
    Apaprently not

    • dk

      well it’s so complex that no one has a commercial product on the market with 6dof controllers with ir lighs with a self contained headset with a phone platform
      ……….yet …..but soon

  • dk

    ……………vive controllers

    • David Herrington

      That’s a visualization of the 3dof controller as a Vive wand and not a Vive wand itself. – from youtube author

      • dk

        yep he made that clarification …..but articles did mention integration of other controller systems…besides the 3dof controller emulating 6dof

  • Miqa

    While very nice, unfortunately all of these upgrades seem like afterthoughts. If they intended this from the start, the cameras would probably be placed differently. Seems like the FOV of the cameras will cripple this functionality.

  • Anthony Kenneth Steele

    Oculus santa cruz comes with 6dof controllerS