Modeling Body Language from Speech in Natural Conversation


Examples of synthesized animations

Sergey Levine


This page contains examples of synthesized animations generated with the body language synthesis system described in my report "Modeling Body Language from Speech in Natural Conversation".
All animations presented on this page are excerpted from the 7-minute test set used to obtain all of results presented in the thesis.
All parameters are synthesized with a remapped HMM trained with a 3-step time window (at 1/3 of a second per step) and 48 hidden states.

Sequence #1
Motion capture
Ground truth parameters,
synthesized motion
Offline Viterbi-generated parameters,
synthesized motion
Online synthesis using direct probabilities,
synthesized motion
Online synthesis using forward probabilities,
synthesized motion
Online synthesis using hybrid method,
synthesized motion

Sequence #2
Motion capture
Ground truth parameters,
synthesized motion
Offline Viterbi-generated parameters,
synthesized motion
Online synthesis using direct probabilities,
synthesized motion
Online synthesis using forward probabilities,
synthesized motion
Online synthesis using hybrid method,
synthesized motion

Copyright Sergey Levine, 2009