Meta Reveals VR Headset Prototypes Designed to Make VR ‘Indistinguishable From Reality’

37

High Dynamic Range

Zuckerberg said that of the four key challenges he and Abbrash overviewed “the most important of these all is HDR.”

To prove out the impact of HDR on the VR experience, the Display Systems Research team built another prototype, appropriately called Starburst. According to Meta it’s the first VR headset prototype (‘as far as we’re aware’) that can reach a whopping 20,000 nits.

Image courtesy Meta

The goal of HDR however is not to fry your eyes, but to give realistic luminance to things that actually are starkly bright in real life. For instance a fire, explosion, firework, or even bright reflections off of a window on a cloudless day. All of these things seem to ‘pop’ in real life because they’re so much brighter than the world around them. Being able to replicate that ‘pop’ of brightness in VR is essential to passing the visual Turing Test, says Meta.

For comparison, Quest 2’s display maxes out at 100 nits, and high-end HDR TVs reach around 2,000 nits. That means the Starburst prototype can produce a range of brightness that’s 10 times brighter than even some of the best HDR TVs out there.

And while Sony’s upcoming PlayStation VR 2 is expected to be the first commercially available HDR VR headset, ‘HDR’ isn’t exactly well defined, so there’s no telling if it will hit 1,000 nits, let alone 2,000.

Downsizing

Image courtesy Meta

While many of the company’s prototype VR headsets sacrifice weight and size in order to prove out those fundamental ideas, Meta is also focused on drastically shrinking the VR headset form-factor. To that end, the company has taken its proof-of-concept holographic folded optics research and turned it into a real, working VR headset called Holocake 2.

This impressively compact prototype tackles the two biggest size limitations of contemporary VR headsets: the length of the optical path and the width of lenses.

In order for the lenses in a VR headset to do their job, they must be placed a certain distance from the display. If you move them any closer you simply won’t be able to focus the image correctly. But using ‘pancake’ optics (also known as ‘folded’ optics), effectively shrinks the distance between the lens and the display by ‘folding’ the path back on itself using polarization to bounce the light back and forth before finally reaching the eye.

As you shrink that distance you start to see that the thickness of the lenses are actually further limiting how close you can put the display to the eye. To that end the Holocake 2 prototype uses holographic lenses which are significantly thinner than traditional lenses.

These are essentially thin holographic films that have a hologram of a traditional lens embedded within them. Even though they’re thin, they manipulate light similarly to the thicker lens which they are modeled from.

Image courtesy Meta

The combination of holographic lenses and pancake optics—hence holo cake—is the key that makes Holocake 2 so compact.

“The creation of the holographic lens was a novel approach to reducing form factor that represented a notable step forward for VR display systems,” says Meta. “This is our first attempt at a fully functional headset that leverages holographic optics, and we believe that further miniaturization of the headset is possible.”

Image courtesy Meta

However, this is a PC-tethered headset which means that it will need some additional bulk (compute and battery) in order to reach the standalone form-factor that Meta is gunning for. And unfortunately, Meta says, Holocake 2 requires a laser light source to make its holographic optics work well, and they aren’t yet at the size or cost needed to be practically implemented in a real product.

Continue on Page 3: The Cambrian Era »

1
2
3

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. See here for more information.


  • Engorged

    Wow, amazing stuff coming from Meta. They really see the full potential of VR.

  • Steven Lewis

    Thanks for this very detailed article! Fascinating stuff.

    • Jasmine Scott

      I am able to get paid 80 dollars hourly to do easy tasks on home computer.^gs28^I have not ever thought like it could be even possible but one of my confidant mate was collecting $25k just within four weeks completing this easy offer and also she has influenced me to join.^gs28^Get further details visiting this page….
      —->>> https://g­o­.­sv/hy5qdS

  • XRC

    Great article and good information dump from meta. Fascinating to see what some of those billions have bought.

  • xyzs

    Meta means beyond in ancient greek..?
    They should call their company MetaLate.

    • Angelos Panayiotou

      Just means later or after in modern Greek

  • Martijn Valk

    Very informative article, thanks! Still not a fan of Meta but I have to admit it’s impressive what they’re achieving so far.

  • Bram

    holocake 2 looks very familiar…a while ago we have seen a leaked picture by meta themselves of Andrew Bosworth wearing it and the media picked it up as the upcoming project Cambria, but now we know it wasn’t that. absolutely interesting design, i think it’s what we imagine a vr headset will look like at some point. Still, no word about fov in this context, unfortunately…

    • dk

      that headset is basically a test vehicle for the optics …other aspects r not developed furter in that test headset ….Norm said its basically a quest but tiny and it’s also wired to a pc it’s not standalone
      …there r 2 long videos about the headsets …one from meta themselves it’s on uploadvr’s youtube and the orher is on tested youtube channel

  • James Hughes

    Our society, government, planet-environment and interpersonal relationships have gone to shit. Instead of people using virtual reality equipment to look around the artificial world, move around in it, and interact with virtual features or items, why don’t we throw billions at solving real-world problems and have real world interactions?

    • Walkabout

      Sometimes solutions come from indirect technologies. You can definitely cut down on emissions by not needing to travel as much if VR gets good enough for example.

    • dk

      why r u wasting time writing a comment when in that time u could have fed a homeless kitten …what a monster

      if billions weren’t spent on various industries u wouldn’t be able to say whatever u want to anyone around the planet interested in this article

      ….u use headphones right ….arvr will augment your vision the same way headphones augment your hearing……and one day u will be able to meet any relative or anyone around the world indistinguishable from meeting in reality

      • James Hughes

        Why aren’t you drinking semen instead of wasting my time.

        • dk

          xD haaaa well how do u know I’m not doing that in my free time
          ….it’s funny where your mind went when u realized I’m right

      • I wanna meet a virtual Moe Szyslak.

    • Rand

      Sure, we are a society that blames the tools for the crime. Guns kill people, spoons make you fat, phones and tech make people less human. No on all counts. You know what makes young people have issues meeting people? The fact that mommy and daddy tossed a tablet in front of their kid and let it take over parenting. Kids bury their faces in phones and tablets to avoid social situations. Good parents don’t let that happen. Want a kid that will rule the world? Let them learn the tech but do not let it own them, do not use it as a crutch.

      Kick your kid out of the house without a phone, its okay, we survived as a species without a digital tether for hundreds of thousands of years. Tell them not to come back till the street lights turn on… but when they do they have 15 min. or else. Then let them have the phone. Its okay, they can enjoy technology.

      VR is not a problem for normal people…. the problem is there are less and less normal people.

    • kontis

      WHY ARE YOU EXPLORING THE ISLAND INSTEAD OF FIGHTING THE MOLD IN OUR CAVE?! OUR KIDS ARE DYING AND YOU DO STUPID THINGS LIKE GOING OUTSIDE.

      What curiosity ever gave us? 100x reduction in poverty, 10x reduction of child mortality and 3x longer living. For what? To suffer more More people can live now so mor people suffer in “society” and they suffer for longer because they live longer.
      AMEN Brother! We are the cancer of this world and this is really BAD!

  • Foreign Devil

    That high nits headset needed high level cooling with those bright lights. You could probably blind yourself looking at the VR sun in a game using that one. I’m most looking forward to 20/20 vision resolution while maintaining high FOV.

    • dk

      the percentage of light getting through is not high it’s matching indoor lighting still nowhere close to light outside

    • Well, with a virtual Sol being just like the real one,
      as they also tell you IRL: DON’T STARE AT THE SUN.
      There.
      See how easy that is …?

    • overzeetop

      You can miss me with HDR. Since black (with an oled or similar) is actually 0 light, the only way to get higher dynamic range is to increase the brightness. It’s like offering a headphone that can produce 200dB of sound you really feel like you’re in the concussion zone of a munition. I don’t want to suddenly be blinded by a scene, going from dark to full daylight. without some kind of safety interlock, this feels like a lawsuit waiting to happen. And with an interlock, it’s still a lawsuit, just with a longer fuse until the interlock is broken or circumvented.

  • Till Eulenspiegel

    One day you will tell your grand kids that people used to wear a box on their face. It’s like seeing those photos of luggage bag size laptop. People will also laugh at how people had to turn this round thingy to drive a car.

    • kontis

      Just like our grandparents told us how they had to use big, bulky headphones to have proper acoustics and ear isolation and now we have that perfect sound in tiny earplugs… oh, wait no we don’t. W still buy bulky headphones to achieve that.

      Or like our grandparents had to buy big cameras with big lenses to get great bokeh and a very high amount of light to make really beautiful photos. Now we can just pull out a smartphone and we get the same bokeh…
      Oh, wait, no we don’t. It’s just a post processing filter that never works correctly and the amount of photons hitting the tiny lens is never as good. So photographers still use cameras as bulky as 50 years ago.

      Or how people in the early 00s had tiny cellphones that fit even in tiny pockets and anyone using large cellphone was lame for having a big brick and now… everyone has a brick. Wait… wasn’t the tech supposed to miniaturize?

      Or how our grandparents had watches with batteries that lasted decades. And now the battery lasts 24 hours. Such progress… :)

      The point is: technology isn’t magic. Physics are a serious limitations. Some things will never be miniaturized. It never goes exactly as predicted. Same will probably happen to XR.

      • Till Eulenspiegel

        You can continue to use this IBM hard drive, it’s as big as a fridge and has a huge 5MB storage.

        https://uploads.disquscdn.com/images/ddacb802f0f290343bb1f59700e40d3cdc46d8a3044f0c55bac6d7b07426d1bc.jpg

      • overzeetop

        Ok, boomer.

        Seriously – practically every case you mention relies on a standard that is the realm of the 0.001%. Headphones for great acoustics – yes, IEMs produce nearly everything – *and* add noise cancelling. Computational photography? Modern smartphones produce results in low light which was impossible with film and even an F1.0 lens of 40 years ago. You can still get more with optics – but 99.999% of the time its just not necessary. And, as for bokeh, if you live in a world where it’s required and the automation isn’t sufficient, we can add it in post to look better than – or exactly like, any glass optics. Brick smartphone? Try miniaturized computer, camera, and GPS tracker that can place a video call. If you want a little phone, connected devices allow you to talk to anyone in the world with a mere pendant or a watch. Watch batteries lasted decades? Oh, sure, just as long as you reset them manually to make up for inaccurate time keeping; todays connected devices are synchronized with atomic clocks. BTW – did your grandparents own a watch that could make a phone call, check the weather anywhere in the world, give you turn by turn, real-time directions, call a family member if you fall, or detect a cardiac arrhythmia? No, I didn’t think so.

        Physics will limit certain functions, but we’re learning new tricks to compensate for those limitations on a daily basis. What our grandparents did with the tools they had was phenomenal, but no more so than the true cutting edge of development today.

  • Very very interesting! I mean, it’s all smoke, because nothing of this is coming to our shelves soon, but it’s interesting to have a peek into what they are working on

  • alxslr

    So FOV is way down on the list, after varifocal, HDR, retina res, and almost everything else.
    Help us Valve/Sony, you’re our only hope.

    Great for the rest of innovations and ideas, but this absence of interest in field of view is so sad…

    • Rainy

      FOV is a distortion problem that is being worked. it’s not as simple as bigger lenses or simply willing it to be so, as the lenses have to be designed with the desired FOV in mind and software has to correct that lenses distortion, and the best way to do that is to have a camera track the eye and do software adjustments. The reason most high-fov headsets today are Fresnel is because of their ability to be stacked, but these headsets also have the highest levels of distortion (pimax, vive pro 2). The demonstration on distortion was related to FOV as we need to find a solution for the distortion before we can raise the FOV, but you have to go one step at a time. It also doesn’t make sense to research only one thing at a time, all these headsets were primary separate from the others and were used to prototype specific technologies, not a whole stack. Their current prototypes are low FOV because they are focusing on the effects of clarity, and introducing extra variables like the distortion (which is a separate research project in itself) could skew the results. The FOV “prototype” (not really, more of the research branch for that) can be considered the TV that simulates distortion in lens designs. Eventually the tech stack will find a spot to merge together.

      • kontis

        One challenge is optical (physics), another one is rendering (software and computing hardware). Both are HUGE and “not worth it” for companies targeting mainstream, especially because wider FOV makes resolution and the sim sickness problems even worse. So NOT bothering with FOV helps them in 4 different ways. The incentive of the market is insanely anti-FOV currently…

        The incredible irony here is the fact that current XR revival was caused by a HMD that gave up on everything to achieve wide FOV (Oculus DK1 – it had wider FOV than anything Oculus ever released again…)

  • jimbo5Z

    Over an hour hands-on with Meta’s New VR Headset Prototypes. On Adam Savage’s Tested with Norman Chan – on Youtube

  • philingreat

    That doesn’t make any sense. Why would Meta announce that before releasing the Cambria?

    • Usually, companies release news like Meta did yesterday whenever
      they get wind of a competitor’s about to make an important announcement.

    • dk

      it’s an ad ….explaining to the stock investors where the billions for rnd r going

  • xyzs

    They could also do some minor hardware upgrades but more often instead of waiting 10 years that all their issues are fixed… A Quest 2 Pro with a better SoC and better screens wouldn’t hurt. Cool to see that but for us who are not working in their labs, that just doesn’t exist.

  • 144Hz

    It’s nice to see that Zuck is really into vr and he’s taking it seriously. I’ve never seen him excited about anything before.

  • This is everything we already know about, just presented rapidly and with less information by Mark Zuckerberg himself.