Google Announces ‘WorldSense’ Inside-out Tracking for Standalone Daydream VR Headsets

11

Google today announced that standalone VR headsets are coming to Daydream, the first of which will be made by HTC and Lenovo. Supporting these new devices is an inside-out positional tracking system that the company is calling ‘WorldSense’, which “dramatically” improves tracking over previous Daydream devices.

WorldSense is a positional tracking system from Google that’s ‘inside-out’; that means it doesn’t need any external sensors or beacons to track the movement of your head through 3D space. The new fully self-contained ‘standalone’ VR headsets for the Daydream platform will use the new tech to allow for positional tracking which Google says “dramatically” improves the experience compared to prior Daydream devices (and we agree, good positional tracking is a huge benefit to immersion and comfort in VR).

Those prior Daydream devices, which relied on typical smartphones, can only track the rotation of your head. Positional tracking allows the system to detect the movement of your head through space, like forward, backward, up and down motions. Rotational and positional tracking together are also often called ‘6 Degrees of Freedom’ or ‘6DOF’.

Positional tracking has long been a feature of high-end PC headsets like the Rift and Vive, but bringing the tech to mobile VR headsets in a practical way has been remained challenging.

The leading VR companies have been focusing on computer-vision as a means to achieve inside-out positional tracking. Such systems rely primarily on cameras on the device to see the real world, and then use algorithms to infer movement of the head from the moving image of the world. Data from other sensors like accelerometers and gyroscopes are also fused into the equation to make tracking more precise.

Google is calling their approach WorldSense, and although we haven’t seen it in action just yet, a short explanatory animation suggests that it not only allows for inside-out positional tracking, but also maps the environment around the user. You can see in the animation that the objects on the table are detected as individual pieces of geometry, and their volume is updated in real-time as the perspective moves.

With a name like WorldSense, Google seems to be implying that the tracking system will be able to work at a huge scale, without pre-scanning or calibration. We expect to get a lot more detail on the tech this week at I/O 2017 so stay tuned.

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. See here for more information.


Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."
  • Flikr

    The big question is, will the motion controller also receive 6dof? They haven’t said anything that would reveal a good way to do that, possibly because Microsoft is having the same issue and giving the answer away would be bad for business. Still, positional tracking without setup is an incredible step forward.

    • Sponge Bob

      motion controller ?

      take your pick: small or 6dof

    • Sponge Bob

      dude

      NoloVR = precise positional 6DoF tracking without setup

  • Lucidfeuer

    So they have ambiguated Tango inside of Daydream, and finally used it for inside-out tracking (although not the most optimal technic). Good, I hope it’ll entice some developers to anticipate and start creating software for future daydream smartphones, but a standalone VR headset…what a terrible idea.

    • Sponge Bob

      standalone means huge battery + heat dissipation

      this alone creates huge headache (in literal sense too – too heavy)

      I tried several standalones from China – they are all heavy (or too short lived on one charge)

  • Sponge Bob

    google is full of sh1t as usual

    just test it in a huge hall with white walls and ceiling

    inside-out tracking DOES rely on outside objects

    • beestee

      That is like saying go test your favorite outside-in tracking outdoors and surrounded by mirrors. It is easy to prove that there are situations that will make the tracking fail, but what is the likelihood of the device being used in that situation?

      • Sponge Bob

        big space alone will fail it

    • trekkie

      If I put you in a “huge hall with white walls and ceilings” I am sure you will walk around like a drunk. The fact that we need outside references is how our own eyes work. Inside out tracking based on SLAM etc are doing the same – no magical tech there, atleast not in this century.

  • Tadd Seiff

    My dodge-ball game does need a little boost…good that we are setting our sights so high on application of this technology…

  • khaled

    Since WorldSense tracking system uses camera to allow for 6DOF movements, why this technology is not available in mobile phones ??