Listen:
Hao says this prototype proved that it’s possible to extrapolate facial expressions hidden under a VR headset with a combination of strain sensors and machine learning algorithms. They are now moving forward on the next iteration of prototypes that should be more practical for consumer-ready prototypes. I previously covered Hao’s research in a write-up on my interview with Martin Breidt.
Hao says that eye gaze is really crucial to having a successful social interaction in VR, and it’s possible that Oculus is working on integrating eye tracking into future consumer VR headsets.
Hao talks about some of the next steps in his facial tracking research, and he’s really optimistic about the metaverse given how his research is helping facilitate the future of telepresence and social VR applications.
Become a Patron! Support The Voices of VR Podcast Patreon
Theme music: “Fatality” by Tigoolio