hao-liHao Li is an assistant professor at USC who has been collaborating with Oculus Research on facial tracking while wearing a virtual reality headset. The group’s initial prototype and research paper “Facial Performance Sensing Head-Mounted Display” was presented at SIGGRAPH 2015.


Hao says this prototype proved that it’s possible to extrapolate facial expressions hidden under a VR headset with a combination of strain sensors and machine learning algorithms. They are now moving forward on the next iteration of prototypes that should be more practical for consumer-ready prototypes. I previously covered Hao’s research in a write-up on my interview with Martin Breidt.

Hao says that eye gaze is really crucial to having a successful social interaction in VR, and it’s possible that Oculus is working on integrating eye tracking into future consumer VR headsets.

Hao talks about some of the next steps in his facial tracking research, and he’s really optimistic about the metaverse given how his research is helping facilitate the future of telepresence and social VR applications.

Become a Patron! Support The Voices of VR Podcast Patreon

Theme music: “Fatality” by Tigoolio

Subscribe to the Voices of VR podcast.

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. See here for more information.

  • brandon9271

    Wow.. This is something i imagined happening down the road. i can’t believe this is already under development! Combine this with eye tracking..holy crap! It’s amazing the advances we’re seeing in the realm of VR and it’s not even comercially available.