Eye-tracking

A typical eye-tracking visualization | Image courtesy 7invensun

Eye-tracking has been touted in the VR industry for years, but the tech has only ever been built into high-end enterprise headsets. Sony may be the first to deliver a consumer VR headset with eye-tracking.

It might not be immediately obvious why you’d want to be able to track the user’s eyes in a VR headset (especially if you’re already tracking the motion of their head), but it turns out that eye-tracking can be a game-changer for VR in many ways.

One of the big ones of course is ‘foveated rendering’. Since our eyes only see sharply in a fairly small central region (the fovea), rendering scenes in high detail in your peripheral vision is a waste of computing power. If you can track exactly where the user is looking, you can render the center part of each frame in high detail while reducing detail in the periphery where it won’t be noticed. This means games can look more detailed without using more computing power.

But eye-tracking goes far beyond just foveated rendering. Sony has only explicitly mentioned foveated rendering so far, but the tech could also be used for automatic IPD measurement, automatic user sign-ins, realistic eye movements for multiplayer avatars, intent tracking, and even eye-based input. Having eye-tracking in PSVR 2 essentially opens up a whole new door of possibilities for VR developers.

Controllers

Image courtesy Sony

One of the biggest improvements to PSVR 2 will the new ‘Sense’ controllers.

PSVR 1 relied on outdated PS Move controllers that weren’t very precise and also lacked thumbsticks which made them awkward to use for some games.

Like other headsets with inside-out tracking, the PSVR 2 Sense controllers will be tracked from the cameras on the headset itself. This is stands to vastly increase the controller tracking coverage because users can now turn around without blocking the PS Camera from seeing their PS Move controllers. And because the Sense controllers are made from the ground up for VR (unlike the PS Move controllers), we expect the quality of the tracking will be improved too.

Crucially, the Sense controllers are also jumping in line with all other modern VR controllers in terms of inputs. They’ll have thumbsticks and two face buttons, which has become the defacto standard with the likes of Oculus Rift, Quest, Valve Index, Reverb G2, Vive Focus 3, and more. Having the same button-and-stick layout across all these controllers makes it easier for developers to port their games from one headset to another.

Image courtesy Sony

And then there’s the enhanced haptics of the PSVR 2 Sense controllers. Sony says they will include advanced haptics similar to what’s in the impressive PS5 controller. That means adaptive triggers that can change how each pull feels, and highly-detailed haptics that go far beyond the basic rumble motors in the PS Move controllers.

Audio & Headset Haptics

Amidst a very impressive list of capabilities listed above, audio might be the Achilles’ heel of PSVR 2.

It’s here where we’d love to say ‘Sony is following every other major headset maker by including on-board audio on PSVR 2’. Alas, this isn’t looking to be the case.

The specs Sony has released so far mention nothing about on-board audio for PSVR 2. The only detail relating to the headset’s audio so far is that it will have a 3.5mm headphone jack, just like the original. Instead it looks like PSVR 2 will rely on plug-in earbuds, though they will at least have a custom cable length and little stowable slots like the second iteration of the original PSVR.

While it doesn’t seem like a big deal to stick earbuds in your ears after putting on the headset, the VR headset market has clearly shown the demand for on-board audio that doesn’t require any additional fiddling.

SEE ALSO
Meta Cancels F8 Developer Conference This Year to "build the metaverse"

Sony has also confirmed that PSVR 2 will include head-mounted haptics (another first among commercially available headsets). That means that, like the controllers, the headset itself will be able to shake in response to things happening in the virtual world.

– – — – –

All things considered, PlayStation 2 is shaping up to be a significant upgrade over Sony’s first headset. Beyond that, it looks like PSVR 2 may launch with several first-to-market features among consumer headsets, like HDR, eye-tracking, and head-mounted haptics. We’re still waiting to learn what this impressive package will cost or exactly when it will launch.

1
2

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. See here for more information.


  • Great comparison. I think that PSVR 2 is a very solid headset, I can’t wait toread the first hands-on reviews!

  • JB1968

    Good article where comparison makes sense. UploadVR should learn here.

    • Sophie Ross

      I’ve even earned $19618 working at my from home via my PC.~wq9~Since I lost my previous job I was a bit agitated and was pleasantly surprised to find an easy online task and that’s the reason I’m able to earn a thousand dollars just at home.~wq9~Everyone is able to take advantage of this simple job and earn more money online by the hyperlink.

      >>>> https://­b­t­c­.­d­o­/googlejob

  • VRFriend

    Announce something which will be released for sale in 10 months? Crazy. Should be immediately, next day or week or month, not at the end of year.

    • Duckman

      lol

      • taret

        Needed to be more lightweight not just a bit

    • Andrew Jakobs

      Well, they haven’t announced anything officially yet.

    • ApocalypseShadow

      They announced PS5 name at CES and released in November. How many months was that?

      What hot item most people want but can’t get for a console? PS5.

      It’s not unheard of. I would love immediate release. But that’s not always the case because they are still planning strategy and dealing with production in this current climate.

  • KLEEBAN KLIBAN

    One thing I havent seen mentioned in articles is that exclusive PSVR2 games will be built ground up for PS5’s fast SSD. Im not sure when it will become common for PC VR games to require SSD, and for now they are limited by HDD compatibility. Though SSD’s are not yet tapped into to the extent I expect they will be, so that may not be a major edge right from the start. I imagine the SSD goes a long way for eye tracking and foreated rendering at the very least, allowing a ton of detail to be added and removed as the player looks to and from different areas. The SSD may be part of the reason Sony can beat the market to this feature in the first place.

    Would love to see what people with much more knowledge than me think about the SSD potential. I think the SSD will be one reason PSVR2 games will hold up well against PC VR even after the next PC HMD’s launch.. at least the PS exclusives. Would love to see Naughty Dog contribute something to VR this gen. Im sure the game they made would look amazing!

    • Lucidfeuer

      A dev who fiddled with a PS5 dev kit explained to me that the faster SSD just saves work on asset streaming, but there’s no seamless and streamlined tool to take advantage of it for now (maybe nanite when it’s eventually optimized for full games), rather it just allows to save on micro-management of memory loads and therefor is more of cop-out for production that a tool being used for now. It’s gonna take some years before you can see it being used to either augment the details of the world streaming or just save on loading times.

  • Charles

    “quality of the tracking will be improved to.”

    Typo in the article.

    • benz145

      Thanks : )

  • FrankB

    I wonder if there will be PC compatibility, given the interesting spec sheet it could well end up being a top class PC headset.

    • shadow9d9

      There is zero incentive for them to do that, especially with the truly abysmal pcvr game sales numbers.

      • Tommy

        Sony will have nothing to do with it. It took modders about 6 months to get PSVR1 working on PC. It should be MUCH quicker seeing as tge PSVR2 is closer to a PCVR headset than it was to the PSVR1.

  • xyzs

    If the lenses are not Fresnel, they really got everything right !
    (except the cable need and the just ok FOV)

  • ApocalypseShadow

    Onboard audio? Why? Leave it to choice.

    PSVR 1 needed the breakout box to process the 3D audio. PSVR 2 does not because of a dedicated sound chip called Tempest built into PS5. Sony gave PSVR 1 gamers a choice on how they wanted to hear be it ear buds or headphones.

    The same great audio that makes Returnal sound the way it does is going to be in VR as well. And that’s just a taste. The same 3.5 audio jack on the Dual Sense where you can use ear buds or headsets to hear that audio is being left up to your choosing again. Different gamers have different preferences on how they listen to sound. Sony is giving gamers that choice on what they want to wear. But PSVR 2 may still have included ear buds in the package just like the first headset if you don’t have any.

    Anyway, PSVR 2 is going to potentially be so far beyond PSVR 1, it’s scary. The graphics, sound and haptics along with analog sticks and 360 movement is going to be on another level. It’s like a gamer jumping from PS2 directly to PS4 Pro or better. Just insane.

    • Arno van Wingerde

      But leaving a cable between head set and console and having the need to insert buds or put up a headset in addition to putting up the headset is an extra hassle compared to Quest more straightforward: “put on headset, switch on and start killing zombies”. I would prefer build-in sound + 3.5 mm for people who want something better. But let’s see how Sony implements this…

      • ApocalypseShadow

        It’s not an extra hassle. It’s only made up to be as if an extra 5 seconds to hook up headphones or earbuds is complicated to those spoiled by that cellphone in a headset. PS VR2 is not wireless or a stand alone headset. So, it doesn’t matter if headphones need to be hooked up.

        The breakout box PSVR had with all the wires is not going to be there for this one. No outside camera to hook up which was another wire. The only wire is the one that attaches to the console.

        If a wire is standing in your way for VR or for listening to sound, I’d suggest sticking with Quest or waiting for Facebook’s next headset. All in one is cool as well as wireless. But, if you want higher quality or a choice in how you want to hear sound, then a wire is a necessary thing until console or PC level quality can be packed into an all in one headset. And with PS VR2’s specs, a lot of gamers are going to forget a wire, headphones or earbuds real quick when they see the games. With a lot of them being exclusive to a wired headset. It’s not even an issue.

        • NL_VR

          Decide not to have onboard audio is a bad thing and probably only to keep cost down.
          earbuds are crap and now if my headphones dont fit over i must get new one.

  • Nepenthe

    Why wouldn’t we expect backward compatibility? I figured that would be a given at least for some stuff even if a per-game patch were required. Don’t most PS4 games play on the PS5? Sure, something that required the PS4 gamepad (like the precursor to Astro-Bot) wouldn’t work, but the PSVR1 has a decent library held back by the HMD and Move.

    • benz145

      Games like Astro Bot are designed for 6DOF input from the controller which isn’t supported by PS5 controllers. My guess is that we’ll see many PSVR games updated for PSVR 2, but there won’t be direct backwards compatibility.

      • Jason Redmon

        As long as they update No Man’s Sky and Elite Dangerous, I’m good

    • The Privileged

      I better be able to play Wipeout, my favorite vr game yet.

  • TechnoHunter

    Sony needs to create a standalone VR Headset in my opinion, and then have the cables provided to hook it up to a PlayStation console, if they want to compete with Quest 2 which I think all VR headset hardware platforms should be doing or moving towards! :D

    • Cless

      Let’s not pollute the market with more shitty ARM mobile CPUs, please. They are in no need to compete with the Quest 2, since they will outsell them easily. As long as they don’t price it ridiculously high that is.

  • The only potential downgrade is the Fresnel lenses, which might introduce some God rays–I really hope not–but everything else looks to be either on par or a huge step up.

    • NL_VR

      God rays is only a problem white on black etc, in games and graphics it not problem at all on todays headsets.

      • Arno van Wingerde

        I disagree, particularly for an HDR set with major contrast ratios between dark and light areas. On the Quest, with a downright pathetic contrast ratio it is already an issue, for a better set I would definitely expect trouble.

        • NL_VR

          i have not experience any problems with godrays when gaming.
          Maybe you talk about something else, like watching pictures or movies i dunno.

      • Andrew Jakobs

        Uhm, I guess you only play bright colored sunny games or something, as godrays are still quite a problem. But the PSVR2 apearantly has a coating on the edges of the ribs which will reduce the effect even further as whats on the market.

        • NL_VR

          No i dont i play many different games.
          Give examples of games that have problems with godrays i look them up.

        • NL_VR

          you dont have any example of games?

      • Not as big a problem, but it’s still an issue. I mean, if I’m trying to watch a movie in some virtual cinema on Quest 2 then the God rays are still a real pain in the ass. So it can definitely still be improved.

        • NL_VR

          yes it can be improved but its not that big of a problem when gaming at least.
          of course there are situations were it can be a problem but i feel like many make the problem bigger than what it really is.

          • Yeah, I mean you are right; in games it’s very rare an issue outside of maybe the starting screen or whatever.

  • Very interesting comparison, always up to date!

  • Jonathan Winters III

    Nice but I believe the PSVR2 in the header image is disproportionately larger than it actually is.

  • Daniel Gallo

    i think my question im gonna ask is answered when it said inbetween the lines of inside out tracking..but im still not as Bright as most of you guys out there :) just an advid gamer.

    but if someone can make it Crystal clear for me. will psvr2 be full standing room scale VR via the cameras like quest 2? or is it still sitdown vr like psvr1? thx in advance!