WakingApp announced recently that they’ve completed a series C funding round to secure $4.3M to realise their vision of an immersive content creation platform that everyone can use.
PresenZ is a system developed by VFX studio Nozon which combines some of the essential benefits of pre-rendered imagery with those of real-time interactivity. For the first time the company is demonstrating a room-scale version of a Presenz-enabled scene.
To explain the difference between pre-rendered and real-time CGI, let me quickly take you back to the early days of hand-drawn animation.
Many of the cherished classics from this age, like Pinocchio (1940), were created by having an artist sit down to draw a series of pictures, and then have those pictures played back quickly after one another to create the illusion of continuous motion. Because the amount of time it takes to draw each frame is much longer (let’s say 5 minutes) than the amount of time that each frame is displayed (1/30th of a second, in the case of 30 FPS playback), interactivity is impractical—you might ask for a character to make a movement in the scene that requires 1000 frames and it would take more than three days just to draw the frames for that movement. However, if the artist can drawn simply enough—like a stick figure flip-book animation—they may be able to produce your desired result in a matter of minutes.
This is very much like the difference between pre-rendered and real-time CGI. Imagine now that instead of an artist drawing each frame, a computer is doing the drawing. A very detailed frame may take the computer five minutes to draw, depending upon how powerful it is. At a drawing (or ‘rendering’) rate of one frame per five minutes, interactivity is still impractical because you may ask for a change that takes several minutes to be produced. It makes more sense to plan what you want the computer to draw ahead of time, then simply gather up all of the frames after they have been drawn and then play them back to back to create a sense of continuous motion. This is pre-rendered CGI: the frames are drawn (‘rendered’) before (‘pre’) viewing.
For this reason, pre-rendered CGI is the preferred method for creating very high fidelity imagery, like that seen from major animation studios like DreamWorks and Pixar. The graphics in films from these studios far surpasses what your computer or Xbox can render because pre-rendered films have the time to spend many seconds, minutes, or even hours on each frame, so long as you will view them all strung together at some point in the future. But that means no interactivity because the viewer is not there during the rendering process to dictate the action (and even if they were, it would take to long to see the results).
See Also: DreamWorks Reveals Glimpse of 360 Degree ‘Super Cinema’ Rendering for VR Films
But if you make the frames simple enough (like the stick figure flip book animation) such that the computer can draw many per second, you can reach a level of practical interactivity where you can ask the computer for a change and see the resulting frames nearly instantly. This is real-time CGI: the frames are rendered as fast as they are being displayed (‘real-time’). Real-time CGI opens the door to interactivity, like being able to pick up a virtual object or press a button to open a hatch; depending upon the user’s input, new frames can be drawn quickly enough to show the result of an action instantly, rather than minutes, hours, or days later.
For this reason real-time CGI is the preferred method for creating games. Interactivity is a crucial element of gaming, and thus it makes sense to bring the graphics down to a point that the computer can render frames in real-time such that the user can press a button to dictate the action in the scene.
So simply put, pre-rendered CGI excels in visuals while real-time CGI excels in interactivity. They’re not fundamentally different except for how long it takes to draw the action.
For the entire history of CGI, creators have had to choose between the high fidelity visuals of pre-rendered CGI or the interactivity of real-time CGI. Then along comes Presenz, promising to mash together these two formerly incompatible benefits into a single solution.
Nozon first revealed Presenz in early 2015, demonstrating positional tracking parallax—the ability to look around objects as you move your head through 3D space—in a small area around the users head in a scene with animated pre-rendered CGI visuals with complexity which would otherwise bring a real-time game engine to a halt.
I’ve seen it for myself and it’s everything they say it is: the visuals of pre-rendered CGI with the positional tracking parallax that’s normally only possible with a scene rendered in real-time. The area in which you can move your head about the scene is only about a meter square. If you hit the edge of that area the scene will fade out as the view of the scene in the area beyond that space has not been pre-rendered. This is of course a limitation if users want to be able to crouch, jump, or walk around a larger scene.
For the first time the company is now showing a room-scale Presenz-enabled scene which is navigable with the HTC Vive & Lighthouse tracking system. In the video above, we see a pre-rendered scene which can be navigated from one end to another seamlessly just like a real-time experience. Nozon calls the scene’s viewable area the ‘zone of view’ rather than a singular ‘point of view’ (as you would be stuck with using a traditional pre-rendering approach.
So what’s the downside to this seemingly magic solution to the pros and cons balance of pre-rendered vs. real-time CGI? Well for one, interactivity is currently limited. You may be able to navigate through the scene, but interaction in the traditional real-time sense is not possible as the scene is still pre-rendered. Nozon says that they’re developing the ability to add real-time interactive elements into their Presenz scenes, but so far they’ve only demonstrated support for pre-rendered animations.
Another downside to Presenz is file size. Relatively simple scenes can climb to the gigabyte count quickly (likely scaling with the size of the zone of view), though Nozon says they are working on compression schemes which “make it possible to reduce [the file size of] some scenes by a factor 10.”
Framerate is also another downside. A Presenz scene can only currently be animated up to 25 FPS (though the headset still views the scene at its own native refresh rate). It isn’t clear yet if this is a technical limitation or a means to keep the file size down.
Those of you following along carefully will probably notice some commonalities between the Presenz solution and lightfields. I certainly did, and so I queried Nozon about the differences between the two. The company insists that, despite the similarities, Presenz is a patented solution which differs from lightfields. My efforts to understand the precise differences didn’t get very far as the company is understandably careful not to dig into the specifics of their technology.
See Also: OTOY Shows Us Live-captured Light Fields in the HTC Vive
However, Nozon’s Matthieu Labeau provided me with a broad comparison between the two solutions (the skeptical reader will understand that this list is likely to lean in Nozon’s favor):
Benefits
Benefits
Current Limitations
Current Limitations
Computer Minimum Specs
Oculus recommended spec + Raid0 SSD
Computer Minimum Specs
Both technologies are still in development so the list here is likely to be in flux for a while to come. Either way, Presenz seems to be making good headway in combining the benefits of pre-rendered and real-time CGI, though there are still a number of limitations that will need sorting before broad application of the technology is possible.
Samsung today became the first company to market with a consumer oriented virtual reality headset in decades as its Samsung Galaxy mobile phone powered Gear VR launched in the US today.
Ben Lang jokes that we’ve been at ‘Year Zero’ of VR for three years now, and the official release of the Gear VR today marks the first official launch of a consumer-ready virtual ready head-mounted display. Ben joins me on the podcast to talk about some of the technical details that allow the Gear VR to drive such a compelling virtual reality experience, as well as some analysis of the larger virtual reality market. There are a lot of high expectations that virtual reality will be able to grow and evolve into the ultimate potential that we all hope it can be, and so we take a look at how the smartphone market evolved over time and what we can expect to see over the next year.
Pre-orders for the Gear VR, the mobile VR headset made in collaboration between Samsung and Oculus, opened up on November 10th. With the headset due to be released on the 20th, it looks like Best Buy has sold out of its initial stock, but other stores remain stocked.
Matt McIlwain is a managing director at the Madrona Venture Group, which recently announced their first investment in the virtual reality space with a $4 million Series A round of funding for Envelop VR. Matt talks about why Seattle is one of the top hotbeds for augmented and virtual reality because there’s a wide variety of hardware, software, gaming, and cloud computing companies including HTC, Valve, Oculus, Facebook, Amazon AWS & Twitch, Microsoft Xbox & Hololens, and Nintendo of America. Matt talks about Madrona’s investment in Envelop VR as well as their strategy finding companies building horizontal software for AR and VR as well as other vertical commercial opportunities of new models of distribution that AR and VR enables.
EVE: Gunjack, The mobile counterpart of the hugely anticipated VR multiplayer space shooter EVE:Valkyrie, is released tomorrow on Samsung Gear VR. We go hands-on with the consumer release and find out that CCP Games have succeeded in setting a new benchmark for visual fidelity in mobile virtual reality.
Nokia has sent out invites for a forthcoming event in Los Angeles on November 30th asking guests to “join us for the exclusive unveiling” of Ozo, the company’s professional VR camera.
As developers continue to experiment with a range of VR navigation techniques, Virtuix’s Omni treadmill gives gamers a way to physically walk and run around virtual worlds in an otherwise limited space. The company’s latest developments bring compatibility with the HTC Vive and its Lighthouse tracking tech, enabling ‘decoupled’ manipulation of walking, looking, and aiming.
Crytek has today released the Back to Dinosaur Island tech demo for download. The five minute demo showing a perturbed T-Rex is compatible with Oculus Rift DK2 headset and built on CryEngine.
Felix & Paul, the studio that recently signed the “largest live-action VR deal to date” with Oculus, has released three episodes of Lebron James’ new mini-series, Striving for Greatness, via Facebook 360° video.
As time goes on and as more and more people have a chance to experience good, cutting edge virtual reality, advocates for the technology are springing up in the most unlikely of places. Now, actor and all round patron of the arts Kevin Spacey has gone on record saying he believes immersive technology holds the future of entertainment, so much so he’s invested in a VR company.
Oculus CTO John Carmack confirmed that an official screen capture solution is on the way to Samsung’s Gear VR headset, pending a future update, in response to a question on Twitter.
For ‘causal’ virtual reality to take off—the kind that you and I can create and share as easily as we do with photos today—it needs to be accessible. Google Cardboard has made important strides in introducing people to the low end of the immersive spectrum, but there’s still a lot of friction in the user experience, on both the software and hardware ends. Figment VR aims to fix the latter.
