Today at GDC, HTC announced plans to make available a lip-tracking module for the Vive Pro. The company says it doesn’t currently have plans to consumerize the device, but instead wants to make it available for research and experimentation.

HTC Vive America’s Vice President of Product and Operations, Vinay Narayan, today at GDC revealed that the company is plans to make available a lip-tracking module for the Vive Pro headset which will accurately gather data about how the user’s mouth is moving. This data could be used for a variety of purposes, like more realistically animating an avatar’s facial expressions in real-time, motion capture recording for NPC animations, or a variety of research uses involving speech, body language, and more.

HTC has revealed very little about the lip-tracking module so far, but we’d venture to guess that it will consist of a camera mounted underneath the Vive Pro visor which faces the user’s mouth. The module could tap the Vive Pro’s hidden USB port for power and data transfer, or could have its own on-board power and communicate to the host PC wirelessly.

New Procedural Speech Animation From Disney Research Could Make for More Realistic VR Avatars

Wit the upcoming Vive Pro Eye, a version of the headset with built in eye-tracking, the lip-tracking module would be even more powerful as it, combined with eye-tracking data, could animate both eyes and mouth together, leading to a richer avatar representation.

HTC has said that it doesn’t presently have plans to turn the lip-tracking module into a consumer product, but wants to make it available as a development kit for research and experimentation. The lip-tracking module will tie into a Vive facial tracking SDK that the company will make available.

So far the company hasn’t said when the lip-tracking module or the facial tracking SDK will be released or what the the module might cost.

Alternative Text

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.

Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."
  • wow

    I thought they were going to release the cosmos or new controllers? Underwhelming..

    • mellott124

      I agree. Pretty disappointing. The Oculus announcement was also pretty disappointing.

      • Luke Martin

        The oculus announcement dosnt happen until Wednesday

        • mellott124

          Great! Thought the Beatsaber announcement was it. My mistake.

          • mellott124

            Still disappointed! Rift S… yikes.

  • oompah

    Vinay Narayan, ok , I thought some PLA appointed Chinese guy to run corporate affairs, but hey , Vive ppl , ur stuff is too costly, Hmmm its from HTC ,
    Dont u make Vive another HTC,
    what u need to do :
    Release a standalone affordable headset before others. See WMR is cheap, if they add a processing unit (with steam, OpenXR & USB-C to link) then it would cost say 400$ total & that’d be best VR headset to have that’d not require a PC,console or a laptop to run.
    (& I am waiting for it)

  • Ian Shook

    I think it’s a great idea.

  • NooYawker

    There’s a lot of funny things you can do with this feature.

    • madelyn

      Current analysis shows that over 75% people are occupied into internet tasks. On line worldwide is now bigger and more beneficial and generating lots of opportunities. Working at home on-line tasks are trending and transforming individual’s lives. The key reason why it is actually preferred? Simply because it enables you to do the job from anywhere and anytime. You receive much more time to allocate with your loved ones and can plan out journeys for holidays. Persons are making wonderful earnings of $27000 in one week by utilizing the efficient and intelligent techniques. Performing right work in a right direction will definitely lead us in the direction of becoming successful. You can begin to earn from the 1st day after you look at our site. >>>>> RESPOND BY TODAY

  • Valve…Please save us.