Seamless Stitching

The Yi Halo would be similar to other 360 camera arrays out there today, except that it’s specially designed for the Jump Assembler. The Assembler is Google’s cloud-based automated stitching process which turns the footage from the Halo’s 17 cameras into 3D 360 output which has impressive seamless stitching.

An upward-facing camera is housed in the center of the camera | Photo by Road to VR

“The camera combined with the stitching algorithm is the best 360 video solution in the industry,” said Jay Spangler, Executive VR Producer for Two Bit Circus.

With 360 cameras, the videos from each individual view needs to be merged together to create the spherical view. Often times this is done manually, with someone tweaking alignments by hand. It’s a tedious process which often reveals the seams between cameras (where one camera view merges into another) which causes distortions in the final video output that can be visually jarring and downright immersion breaking.

Google’s Jump Assembler not only automates the stitching process—which 360 content creators say saves a ton of time and money—but it does so with the most seamless output I’ve seen from any stitching process. As subjects walk near to the camera (and thus pass through many of the camera’s individual views in quick succession), which is perhaps the most challenging moment for most stitching processes, you’ll be hard pressed to see where one camera view ends and the next picks up.

As importantly (if not more so), the Jump Assembler spits out 3D 360 video which is critical for immersion when viewing 360 video in a VR headset. This is not a trivial feat. Creating good-looking 360 stereo video is not easy, not to mention when you’re dealing with overlapping frame stitching that you hope to remain seamless. Google has pulled this off in a very impressive way with the Assembler and says that stitched footage can be returned “within hours,” saving creators a ton of time in the process, thereby putting 3D capture within arm’s reach of a greater number of productions.

SEE ALSO
New Vision Pro App Brings Faster Typing by Using the iPhone in Your Pocket

Positioning vs. Volumetric VR Cameras

Lytro’s huge Immerge camera is impressively capable, but isn’t particularly portable compared to the Yi Halo | Photo by Road to VR

That’s all well and good, but how does the Yi Halo fit in with volumetric video cameras (which can capture much more immersive VR footage) like the Lytro Immerge and Facebook’s newly announced X24?

Google says that the Yi Halo is of a different production class; whereas the Immerge and X24, the company says, are high-end devices made for high-end productions with lots of post-production and VFX work, the Halo is meant for mid-range productions where a creator needs a portable and reliable camera that’s simple operate, and outputs footage that fits within their existing toolset. The difference, the company alluded, is like shooting against a green screen with a high-end cinema camera vs. a more rugged and portable camera that you’d take on-site.

That said, Google could potentially get into the volumetric capture game. The Jump Assembler is already capable of producing depth-maps (one important piece of volumetric capture), though they aren’t presently returning volumetric video entirely. We inquired about volumetric capture but the company was tight-lipped on what it might do in the future.

A Leap, In Some Aspects

Thanks to its reliability, cohesive components, portability, and broad operating specs, the Yi Halo may represent a big step forward as far as the content creator is concerned. But when it comes to the end user, the Halo is just like a lot of other 360 cameras we’ve seen: there’s still a long way to go in visual quality.

You can see output from the Halo, crunched with the Assembler, right here (to watch in VR, see the instructions in this article). Having watched this played back through a Daydream headset on a Pixel phone, to my eyes there’s a major lack of dynamic range on the low end, resulting in dark colors being very hard to discern from one another.

SEE ALSO
A New Category of VR Game is Slowly Emerging Right Before Our Eyes

Without a side-by-side test, the quality of the image doesn’t feel sharper than some of the better 3D 360 footage that we’ve seen before, though the seamless stitching is a big improvement over a lot of other 360 content out there.

– – — – –

The Yi Halo appears to be exactly what 360 video creators need: an affordable, reliable, cohesive 360 camera system that makes capturing high-quality 3D 360 video easier than ever before. With automated and seamless stitching, the Halo is poised to allow creators to better focus on what’s being filmed, not the intricacies of how it’s being filmed.

The Yi Halo begins limited availability today (check out the website for more info) and will go on sale more broadly this summer.

1
2
Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.


Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."
  • NooYawker

    I’ve been waiting to see what Google tosses into the ring… this is not what I was expecting. So instead of a rig holding GoPro’s in a circle it holds a GoPro knock off, the Yi.

    • OhYeah!

      It’s less about the cameras and more about the software for stitching it all seamlessly in high resolution all from the camera rig.

      • Yi vs GoPro is probably fine, but it’s still a ring so even if you resampled the light field captured by the cameras you will only ever get 4DOF video. It’s an unfortunate limitation at this price point. You will never have vertical motion parallax or be able to tilt your head sideways (I think most people tend to subconsciously slightly tilt their head one way or the other about 5° or so when watching free-viewpoint content).

  • Zach Mauch

    I love hearing about each one of these little jumps taken. We are still a way off from mass distribution of consumer VR video, but it is really cool to hear were the future is heading. I think within 5-10 years we will have stand alone (on-board processing) headsets that also have on-board positional sensing.

    I expect to be able to use this to view live volumetric feeds of sporting events like you are really there. Imagine being able to pick a location on a football field or NBA arena. Add on top of that the possibility of time shifting (DVR) capability. This is when you TRULY start getting a home experience that is better than being there.

  • metanurb

    Xiaomi banggoodtastic.

  • Oscar

    Is this supposed to be good quality? LOL? It looks like it’s been filmed
    with cellphone camera from 5 years ago ffs. Just looks at this mess: http://abload.de/img/8k_lol9ys1x.jpg (Crop from the 8K source from the Woman with Child + Dog)

    • Mr Whitenoise

      the question is, how many degrees is that crop wide ?

      • Oscar

        Well, here’s the uncropped original if it’s important: http://abload.de/img/uncroppedjzxxb.jpg

        Still very bad quality, nowhere near the quality of a regular 4K video, or 8K for the matter. As a comparison, here’s a 4K cap from an 8K video with the quality set to 4K:
        http://abload.de/img/uhdyukth.jpg

        Like all 360 videos, quality is uttersh*t.

      • Oscar

        You never got back to me Mr Whitenoise!?

  • Is anyone really in love with 360 video? It’s not VR, it’s more like using VR as a means to show something that’s never really found any other place on it’s own. 360 videos have always been gimmicky. The only interesting videos I’ve seen are computer generated. These articles keep pushing it as the future of VR productions, but I think it’s the distance past. It’s just a relic of 2D motion picture thinking. VR should be interactive, not another means of passive-viewer video production.

    • Mr Whitenoise

      360 imagery viewed in a vr headset is a part of VR… get over it. ;)