New Procedural Speech Animation From Disney Research Could Make for More Realistic VR Avatars
A new paper authored by researchers from Disney Research and several universities describes a new approach to procedural speech animation based on deep learning. The system samples audio recordings of human speech and uses it to automatically generate matching mouth animation. The method has applications ranging from increased efficiency in animation pipelines to making social VR interactions more convincing by animating the speech of avatars in real-time in social VR settings.

Killing Floor: Incursion is a horror game featuring lots of gore that is sure to evoke visceral reactions in players. I had a chance to play a demo at GDC 2017, and I can say that it’s definitely an experience that has stuck with me. The mechanics of beating enemies with their dismembered limbs had an extreme amount of blood splattering that it was a mix of being at the same time grossly disturbing and ridiculously comic. I had a chance to talk with project lead 











Custom avatars in social VR add a lot of fidelity of identity expression and creative flair in applications like VRChat or High Fidelity. 




