Google this week introduced a new “High Quality” option for their Jump Assembler, an automated 3D 360 video stitching service for creators shooting with Jump cameras. The new approach brings more accurate stitching with enhanced depth maps resulting in sharper 3D output.

In a blog post this week, Google software engineer David Gallup detailed the new High Quality stitching option for creators using the Jump Assembler. He explained that the prior method uses an “optical flow” approach, which uses pairs of cameras to match pixels between each camera’s perspective, and then interpolate the view from one camera to the other.

While the old method will still be available, the new High Quality algorithm expands the number of cameras which can contribute to determining the distance to objects. As Gallup puts it, “[…] the new multi-view stereo algorithm computes the depth of each pixel (e.g., the distance to the object at that pixel, a 3D point), and any camera on the rig that sees that 3D point can help to establish it’s depth, making the matching process more reliable.”

Side by side photos of the output from both the original method and the new method shows cleaner stitching, especially with thin, isolated objects, which are notoriously difficult to stitch reliably:

Standard stitching left vs. High Quality stitching right | Image courtesy Google

The High Quality stitching option not only makes for more accurate alignment of overlapping views, it also produces a much cleaner depth map, which improves the 3D effect when viewing the content and makes VFX work easier for creators. Gallup shared a comparison:

Depth map from Standard stitching left vs. High Quality stitching right (brighter areas are closer to the camera) | Image courtesy Google

In the depth maps you can see not only a significantly sharper outline of the subject, but also much better detection of the rods, which are almost ‘invisible’ to the depth map with the Standard method.

SEE ALSO
Google's 'Welcome to Light Fields' VR App Reveals the Power of Volumetric Capture

Gallup says that 360 filmmakers using the Jump Assembler can now access the new High Quality option through the Jump Manger program for their next stitch.

Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.


Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."