ishi12@interspeech_2012@ISCA

Total: 1

#1 Evaluation of a formant-based speech-driven lip motion generation [PDF] [Copy] [Kimi1]

Authors: Carlos T. Ishi ; Chaoran Liu ; Hiroshi Ishiguro ; Norihiro Hagita

The background of the present work is the development of a tele-operation system where the lip motion of a remote humanoid robot is automatically controlled from the operatorfs voice. In the present paper, we introduce an improved version of our proposed speech-driven lip motion generation method, where lip height and width degrees are estimated based on vowel formant information. The method requires the calibration of only one parameter for speaker normalization, so that no training of dedicated models is necessary. Lip height control is evaluated in a female android robot Geminoid-F and in an animated face. Subjective evaluation indicated that naturalness of lip motion generated in the robot is improved by the inclusion of a partial lip width control (with stretching of the lip corners). Highest naturalness scores were achieved for the animated face, showing the effectiveness of the proposed method.