Project Tango, Google’s computer vision project able to track and map 3D spaces in realtime, may well find its way into future VR projects from the company, but they admit that current developer hardware may not be up to the job.


It’s Day 2 of Google’s annual developer’s conference ‘I/O’ and the company’s focus on virtual reality has intensified versus last year’s event. Mentions of VR have found their way into multiple presentations, most interestingly today during the ‘Project Tango – Mobile 3D tracking and perception’ talk, presented by project lead Johnny Lee.

ptango-white-labels
Google’s Project Tango Development Kit Tablet

Although it would be disingenuous to suggest that the hour long talk focused on virtual reality, it’s clear Google have their eye on the possibility of combining Tango and Cardboard VR for a project in the future. Lee outlined his hopes, saying “Computer Vision and 3D Tracking was going to be an essential part of new mobile experiences, from indoor navigation, to VR, AR and potentially robotics.”

Amongst the tablet-driven augmented reality demos given in the presentation, a brief glimpse of a VR chat application using Project Tango positioning and tracking system was shown. The VR application, powered by Tango technology is aware of its own position in a pre-mapped physical environment and so are any other Tango enabled devices. Put three of these devices in the same room and you can have conversations with people in VR whose virtual position match their real life position in the space.

tango-stage-vr-headset

Tango’s inside-out tracking and mapping capabilities, which uses RGB and depth cameras to sense the surrounding environment’s features, has the potential to provide a pretty compelling indoor motion tracking system for VR headsets. In fact, delegates were given the opportunity to try Project Tango’s VR capabilities at the event. The demo on display was a crude village scene around which users could look using Tango’s spatial tracking (in what looks to be a Dive branded mount).

tango-vr-village-scene

Google are not quite yet there though, and Lee was candid about the current development hardware’s limitations. “So the primary sensor that drives frame updates in VR is actually the Gyro .. there’s no reason why in properly optimised hardware that the gyro performance would be any different to another VR headset”. When pushed on performance said the tablets here are running stock Android and there’s not really any latency optimisations on these devices .. around 80ms or so.”

So there’s potential in Tango to provide real added value to the Google or Android VR experience, or perhaps even drive it completely. It’s clear though at this stage that VR isn’t the company’s focus with Project Tango. With properly optimised hardware however, it could provide the missing piece to the mobile VR puzzle – positional tracking on the go.

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. See here for more information.


  • pittsburghjoe

    If you know the right people a tweaked ROM is available to alleviate the 80 milliseconds

    • zalo

      >knows John Carmack